2023-02-08 00:55:17,543 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-02-08 00:55:17,765 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d 2023-02-08 00:55:17,779 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-02-08 00:55:17,779 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/cluster_30866e7d-579c-f29f-9e7a-6f29114e302b, deleteOnExit=true 2023-02-08 00:55:17,780 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-02-08 00:55:17,780 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/test.cache.data in system properties and HBase conf 2023-02-08 00:55:17,781 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/hadoop.tmp.dir in system properties and HBase conf 2023-02-08 00:55:17,781 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/hadoop.log.dir in system properties and HBase conf 2023-02-08 00:55:17,782 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/mapreduce.cluster.local.dir in system properties and HBase conf 2023-02-08 00:55:17,783 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-02-08 00:55:17,783 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-02-08 00:55:17,881 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-02-08 00:55:18,228 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-02-08 00:55:18,232 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-02-08 00:55:18,232 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-02-08 00:55:18,233 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-02-08 00:55:18,233 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 00:55:18,233 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-02-08 00:55:18,234 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-02-08 00:55:18,234 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-02-08 00:55:18,234 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 00:55:18,235 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-02-08 00:55:18,235 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/nfs.dump.dir in system properties and HBase conf 2023-02-08 00:55:18,235 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/java.io.tmpdir in system properties and HBase conf 2023-02-08 00:55:18,235 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/dfs.journalnode.edits.dir in system properties and HBase conf 2023-02-08 00:55:18,236 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-02-08 00:55:18,236 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-02-08 00:55:18,655 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 00:55:18,658 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 00:55:19,834 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-02-08 00:55:19,986 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-02-08 00:55:19,998 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 00:55:20,034 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 00:55:20,060 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/java.io.tmpdir/Jetty_localhost_localdomain_35247_hdfs____.6wl95f/webapp 2023-02-08 00:55:20,165 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:35247 2023-02-08 00:55:20,202 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-02-08 00:55:20,202 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-02-08 00:55:21,602 WARN [Listener at localhost.localdomain/37369] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 00:55:21,712 WARN [Listener at localhost.localdomain/37369] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-02-08 00:55:21,728 WARN [Listener at localhost.localdomain/37369] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-02-08 00:55:21,734 INFO [Listener at localhost.localdomain/37369] log.Slf4jLog(67): jetty-6.1.26 2023-02-08 00:55:21,739 INFO [Listener at localhost.localdomain/37369] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/java.io.tmpdir/Jetty_localhost_37359_datanode____.7zrq7a/webapp 2023-02-08 00:55:21,817 INFO [Listener at localhost.localdomain/37369] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37359 2023-02-08 00:55:22,107 WARN [Listener at localhost.localdomain/36213] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-02-08 00:55:24,394 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc2b68d4a0ebf491b: Processing first storage report for DS-435253a9-76ab-4295-a971-e474cccc5f92 from datanode 0f7453a4-3ea6-4c3e-bbee-63344e1aef86 2023-02-08 00:55:24,395 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc2b68d4a0ebf491b: from storage DS-435253a9-76ab-4295-a971-e474cccc5f92 node DatanodeRegistration(127.0.0.1:45165, datanodeUuid=0f7453a4-3ea6-4c3e-bbee-63344e1aef86, infoPort=46179, infoSecurePort=0, ipcPort=36213, storageInfo=lv=-57;cid=testClusterID;nsid=30483167;c=1675817718719), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-02-08 00:55:24,396 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc2b68d4a0ebf491b: Processing first storage report for DS-5c9a2e87-6b4c-4496-ab02-708c5d8f3df5 from datanode 0f7453a4-3ea6-4c3e-bbee-63344e1aef86 2023-02-08 00:55:24,396 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc2b68d4a0ebf491b: from storage DS-5c9a2e87-6b4c-4496-ab02-708c5d8f3df5 node DatanodeRegistration(127.0.0.1:45165, datanodeUuid=0f7453a4-3ea6-4c3e-bbee-63344e1aef86, infoPort=46179, infoSecurePort=0, ipcPort=36213, storageInfo=lv=-57;cid=testClusterID;nsid=30483167;c=1675817718719), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-02-08 00:55:24,490 DEBUG [Listener at localhost.localdomain/36213] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d 2023-02-08 00:55:24,538 INFO [Listener at localhost.localdomain/36213] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/cluster_30866e7d-579c-f29f-9e7a-6f29114e302b/zookeeper_0, clientPort=49726, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/cluster_30866e7d-579c-f29f-9e7a-6f29114e302b/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/cluster_30866e7d-579c-f29f-9e7a-6f29114e302b/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-02-08 00:55:24,553 INFO [Listener at localhost.localdomain/36213] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=49726 2023-02-08 00:55:24,562 INFO [Listener at localhost.localdomain/36213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 00:55:24,564 INFO [Listener at localhost.localdomain/36213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 00:55:25,206 INFO [Listener at localhost.localdomain/36213] util.FSUtils(479): Created version file at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435 with version=8 2023-02-08 00:55:25,207 INFO [Listener at localhost.localdomain/36213] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/hbase-staging 2023-02-08 00:55:25,484 INFO [Listener at localhost.localdomain/36213] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-02-08 00:55:25,865 INFO [Listener at localhost.localdomain/36213] client.ConnectionUtils(127): master/jenkins-hbase12:0 server-side Connection retries=3 2023-02-08 00:55:25,892 INFO [Listener at localhost.localdomain/36213] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 00:55:25,892 INFO [Listener at localhost.localdomain/36213] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 00:55:25,893 INFO [Listener at localhost.localdomain/36213] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 00:55:25,893 INFO [Listener at localhost.localdomain/36213] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 00:55:25,893 INFO [Listener at localhost.localdomain/36213] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 00:55:26,025 INFO [Listener at localhost.localdomain/36213] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 00:55:26,083 DEBUG [Listener at localhost.localdomain/36213] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-02-08 00:55:26,155 INFO [Listener at localhost.localdomain/36213] ipc.NettyRpcServer(120): Bind to /136.243.104.168:36763 2023-02-08 00:55:26,163 INFO [Listener at localhost.localdomain/36213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 00:55:26,165 INFO [Listener at localhost.localdomain/36213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 00:55:26,182 INFO [Listener at localhost.localdomain/36213] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36763 connecting to ZooKeeper ensemble=127.0.0.1:49726 2023-02-08 00:55:26,473 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:367630x0, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 00:55:26,475 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): master:36763-0x1014010f5da0000 connected 2023-02-08 00:55:27,326 DEBUG [Listener at localhost.localdomain/36213] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 00:55:27,328 DEBUG [Listener at localhost.localdomain/36213] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 00:55:27,336 DEBUG [Listener at localhost.localdomain/36213] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 00:55:27,345 DEBUG [Listener at localhost.localdomain/36213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36763 2023-02-08 00:55:27,352 DEBUG [Listener at localhost.localdomain/36213] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36763 2023-02-08 00:55:27,352 DEBUG [Listener at localhost.localdomain/36213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36763 2023-02-08 00:55:27,353 DEBUG [Listener at localhost.localdomain/36213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36763 2023-02-08 00:55:27,353 DEBUG [Listener at localhost.localdomain/36213] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36763 2023-02-08 00:55:27,359 INFO [Listener at localhost.localdomain/36213] master.HMaster(439): hbase.rootdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435, hbase.cluster.distributed=false 2023-02-08 00:55:27,420 INFO [Listener at localhost.localdomain/36213] client.ConnectionUtils(127): regionserver/jenkins-hbase12:0 server-side Connection retries=3 2023-02-08 00:55:27,420 INFO [Listener at localhost.localdomain/36213] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 00:55:27,420 INFO [Listener at localhost.localdomain/36213] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-02-08 00:55:27,420 INFO [Listener at localhost.localdomain/36213] ipc.RWQueueRpcExecutor(105): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-02-08 00:55:27,420 INFO [Listener at localhost.localdomain/36213] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-02-08 00:55:27,421 INFO [Listener at localhost.localdomain/36213] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-02-08 00:55:27,424 INFO [Listener at localhost.localdomain/36213] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-02-08 00:55:27,427 INFO [Listener at localhost.localdomain/36213] ipc.NettyRpcServer(120): Bind to /136.243.104.168:36907 2023-02-08 00:55:27,429 INFO [Listener at localhost.localdomain/36213] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-02-08 00:55:27,435 DEBUG [Listener at localhost.localdomain/36213] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-02-08 00:55:27,435 INFO [Listener at localhost.localdomain/36213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 00:55:27,438 INFO [Listener at localhost.localdomain/36213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 00:55:27,439 INFO [Listener at localhost.localdomain/36213] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36907 connecting to ZooKeeper ensemble=127.0.0.1:49726 2023-02-08 00:55:27,656 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:369070x0, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-02-08 00:55:27,657 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(623): regionserver:36907-0x1014010f5da0001 connected 2023-02-08 00:55:27,658 DEBUG [Listener at localhost.localdomain/36213] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 00:55:27,659 DEBUG [Listener at localhost.localdomain/36213] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 00:55:27,661 DEBUG [Listener at localhost.localdomain/36213] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-02-08 00:55:27,662 DEBUG [Listener at localhost.localdomain/36213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36907 2023-02-08 00:55:27,663 DEBUG [Listener at localhost.localdomain/36213] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36907 2023-02-08 00:55:27,664 DEBUG [Listener at localhost.localdomain/36213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36907 2023-02-08 00:55:27,665 DEBUG [Listener at localhost.localdomain/36213] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36907 2023-02-08 00:55:27,665 DEBUG [Listener at localhost.localdomain/36213] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36907 2023-02-08 00:55:27,667 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(2158): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase12.apache.org,36763,1675817725340 2023-02-08 00:55:27,958 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 00:55:27,963 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase12.apache.org,36763,1675817725340 2023-02-08 00:55:28,051 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 00:55:28,051 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-02-08 00:55:28,051 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 00:55:28,054 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 00:55:28,056 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.ActiveMasterManager(224): Deleting ZNode for /hbase/backup-masters/jenkins-hbase12.apache.org,36763,1675817725340 from backup master directory 2023-02-08 00:55:28,057 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-02-08 00:55:28,197 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase12.apache.org,36763,1675817725340 2023-02-08 00:55:28,197 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-02-08 00:55:28,199 WARN [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 00:55:28,200 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.ActiveMasterManager(234): Registered as active master=jenkins-hbase12.apache.org,36763,1675817725340 2023-02-08 00:55:28,206 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-02-08 00:55:28,207 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-02-08 00:55:28,284 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] util.FSUtils(628): Created cluster ID file at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/hbase.id with ID: 28bf9dfa-2d19-49eb-b50e-b5e0a7c8f13a 2023-02-08 00:55:28,324 INFO [master/jenkins-hbase12:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 00:55:28,641 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 00:55:28,682 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x497dcd15 to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:55:28,752 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35becd45, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:55:28,776 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-02-08 00:55:28,778 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-02-08 00:55:28,795 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-02-08 00:55:28,796 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-02-08 00:55:28,797 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-08 00:55:28,801 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:849) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2178) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:523) at java.lang.Thread.run(Thread.java:750) 2023-02-08 00:55:28,802 INFO [master/jenkins-hbase12:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 00:55:28,830 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7689): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData/data/master/store-tmp 2023-02-08 00:55:29,255 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:55:29,256 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 00:55:29,256 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 00:55:29,256 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 00:55:29,257 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 1 ms 2023-02-08 00:55:29,257 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 00:55:29,257 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 00:55:29,257 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675817729256Disabling compacts and flushes for region at 1675817729256Disabling writes for close at 1675817729257 (+1 ms)Writing region close event to WAL at 1675817729257Closed at 1675817729257 2023-02-08 00:55:29,259 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData/WALs/jenkins-hbase12.apache.org,36763,1675817725340 2023-02-08 00:55:29,282 INFO [master/jenkins-hbase12:0:becomeActiveMaster] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase12.apache.org%2C36763%2C1675817725340, suffix=, logDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData/WALs/jenkins-hbase12.apache.org,36763,1675817725340, archiveDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData/oldWALs, maxLogs=10 2023-02-08 00:55:29,333 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45165,DS-435253a9-76ab-4295-a971-e474cccc5f92,DISK] 2023-02-08 00:55:29,339 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-02-08 00:55:29,391 INFO [master/jenkins-hbase12:0:becomeActiveMaster] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData/WALs/jenkins-hbase12.apache.org,36763,1675817725340/jenkins-hbase12.apache.org%2C36763%2C1675817725340.1675817729292 2023-02-08 00:55:29,392 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45165,DS-435253a9-76ab-4295-a971-e474cccc5f92,DISK]] 2023-02-08 00:55:29,393 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7850): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:55:29,393 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(865): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:55:29,396 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7890): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 00:55:29,397 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(7893): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 00:55:29,446 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-02-08 00:55:29,452 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-02-08 00:55:29,474 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-02-08 00:55:29,487 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:55:29,493 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 00:55:29,494 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-02-08 00:55:29,508 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1054): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-02-08 00:55:29,512 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:55:29,513 INFO [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(1071): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60950087, jitterRate=-0.09177292883396149}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:55:29,513 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] regionserver.HRegion(964): Region open journal for 1595e783b53d99cd5eef43b6debb2682: Writing region info on filesystem at 1675817729419Initializing all the Stores at 1675817729421 (+2 ms)Instantiating store for column family {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675817729422 (+1 ms)Cleaning up temporary data from old regions at 1675817729500 (+78 ms)Cleaning up detritus from prior splits at 1675817729501 (+1 ms)Region opened successfully at 1675817729513 (+12 ms) 2023-02-08 00:55:29,515 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-02-08 00:55:29,531 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-02-08 00:55:29,531 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-02-08 00:55:29,533 INFO [master/jenkins-hbase12:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-02-08 00:55:29,535 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-02-08 00:55:29,560 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 25 msec 2023-02-08 00:55:29,560 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(95): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-02-08 00:55:29,581 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-02-08 00:55:29,586 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-02-08 00:55:29,606 INFO [master/jenkins-hbase12:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-02-08 00:55:29,609 INFO [master/jenkins-hbase12:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-02-08 00:55:29,611 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-02-08 00:55:29,616 INFO [master/jenkins-hbase12:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-02-08 00:55:29,619 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-02-08 00:55:29,693 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 00:55:29,694 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-02-08 00:55:29,695 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-02-08 00:55:29,708 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-02-08 00:55:29,995 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 00:55:29,995 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-02-08 00:55:29,996 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 00:55:29,998 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(739): Active/primary master=jenkins-hbase12.apache.org,36763,1675817725340, sessionid=0x1014010f5da0000, setting cluster-up flag (Was=false) 2023-02-08 00:55:30,050 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 00:55:30,381 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-02-08 00:55:30,383 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase12.apache.org,36763,1675817725340 2023-02-08 00:55:30,440 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 00:55:30,785 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-02-08 00:55:30,788 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase12.apache.org,36763,1675817725340 2023-02-08 00:55:30,793 WARN [master/jenkins-hbase12:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.hbase-snapshot/.tmp 2023-02-08 00:55:30,872 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(952): ClusterId : 28bf9dfa-2d19-49eb-b50e-b5e0a7c8f13a 2023-02-08 00:55:30,876 DEBUG [RS:0;jenkins-hbase12:36907] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-02-08 00:55:30,884 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-02-08 00:55:30,892 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-02-08 00:55:30,893 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-02-08 00:55:30,893 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-02-08 00:55:30,893 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=5, maxPoolSize=5 2023-02-08 00:55:30,893 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase12:0, corePoolSize=10, maxPoolSize=10 2023-02-08 00:55:30,893 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 00:55:30,893 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=2, maxPoolSize=2 2023-02-08 00:55:30,893 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 00:55:30,894 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1675817760894 2023-02-08 00:55:30,896 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-02-08 00:55:30,900 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 00:55:30,900 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-02-08 00:55:30,904 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 00:55:30,905 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-02-08 00:55:30,911 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-02-08 00:55:30,911 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-02-08 00:55:30,912 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-02-08 00:55:30,912 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-02-08 00:55:30,912 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 00:55:30,914 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-02-08 00:55:30,915 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-02-08 00:55:30,915 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-02-08 00:55:30,917 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-02-08 00:55:30,917 INFO [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-02-08 00:55:30,919 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.large.0-1675817730919,5,FailOnTimeoutGroup] 2023-02-08 00:55:30,919 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.small.0-1675817730919,5,FailOnTimeoutGroup] 2023-02-08 00:55:30,919 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-02-08 00:55:30,919 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(1451): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-02-08 00:55:30,920 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-02-08 00:55:30,920 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-02-08 00:55:30,927 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 00:55:30,928 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-02-08 00:55:30,929 INFO [PEWorker-1] regionserver.HRegion(7671): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435 2023-02-08 00:55:31,117 DEBUG [RS:0;jenkins-hbase12:36907] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-02-08 00:55:31,117 DEBUG [RS:0;jenkins-hbase12:36907] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-02-08 00:55:31,174 DEBUG [RS:0;jenkins-hbase12:36907] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-02-08 00:55:31,177 DEBUG [RS:0;jenkins-hbase12:36907] zookeeper.ReadOnlyZKClient(139): Connect 0x7e49bcf0 to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:55:31,344 DEBUG [PEWorker-1] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:55:31,351 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 00:55:31,354 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/info 2023-02-08 00:55:31,355 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 00:55:31,357 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:55:31,357 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 00:55:31,361 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/rep_barrier 2023-02-08 00:55:31,362 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 00:55:31,363 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:55:31,363 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 00:55:31,366 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/table 2023-02-08 00:55:31,367 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 00:55:31,367 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:55:31,370 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740 2023-02-08 00:55:31,371 DEBUG [PEWorker-1] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740 2023-02-08 00:55:31,375 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 00:55:31,377 DEBUG [PEWorker-1] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 00:55:31,381 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:55:31,382 INFO [PEWorker-1] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62379963, jitterRate=-0.07046611607074738}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 00:55:31,382 DEBUG [PEWorker-1] regionserver.HRegion(964): Region open journal for 1588230740: Writing region info on filesystem at 1675817731347Initializing all the Stores at 1675817731350 (+3 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675817731350Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675817731350Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675817731350Cleaning up temporary data from old regions at 1675817731374 (+24 ms)Cleaning up detritus from prior splits at 1675817731374Region opened successfully at 1675817731382 (+8 ms) 2023-02-08 00:55:31,382 DEBUG [PEWorker-1] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 00:55:31,382 INFO [PEWorker-1] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 00:55:31,382 DEBUG [PEWorker-1] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 00:55:31,383 DEBUG [PEWorker-1] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 00:55:31,383 DEBUG [PEWorker-1] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 00:55:31,384 INFO [PEWorker-1] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 00:55:31,384 DEBUG [PEWorker-1] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675817731382Disabling compacts and flushes for region at 1675817731382Disabling writes for close at 1675817731383 (+1 ms)Writing region close event to WAL at 1675817731384 (+1 ms)Closed at 1675817731384 2023-02-08 00:55:31,390 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-02-08 00:55:31,390 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-02-08 00:55:31,398 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-02-08 00:55:31,409 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-02-08 00:55:31,413 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-02-08 00:55:31,477 DEBUG [RS:0;jenkins-hbase12:36907] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@708e5d49, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:55:31,478 DEBUG [RS:0;jenkins-hbase12:36907] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74b1d780, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase12.apache.org/136.243.104.168:0 2023-02-08 00:55:31,502 DEBUG [RS:0;jenkins-hbase12:36907] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase12:36907 2023-02-08 00:55:31,505 INFO [RS:0;jenkins-hbase12:36907] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-02-08 00:55:31,505 INFO [RS:0;jenkins-hbase12:36907] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-02-08 00:55:31,505 DEBUG [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1023): About to register with Master. 2023-02-08 00:55:31,507 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(2810): reportForDuty to master=jenkins-hbase12.apache.org,36763,1675817725340 with isa=jenkins-hbase12.apache.org/136.243.104.168:36907, startcode=1675817727419 2023-02-08 00:55:31,521 DEBUG [RS:0;jenkins-hbase12:36907] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-02-08 00:55:31,561 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:39115, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-02-08 00:55:31,563 WARN [jenkins-hbase12:36763] assignment.AssignmentManager(2157): No servers available; cannot place 1 unassigned regions. 2023-02-08 00:55:31,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.ServerManager(394): Registering regionserver=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:31,584 DEBUG [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1596): Config from master: hbase.rootdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435 2023-02-08 00:55:31,584 DEBUG [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1596): Config from master: fs.defaultFS=hdfs://localhost.localdomain:37369 2023-02-08 00:55:31,584 DEBUG [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1596): Config from master: hbase.master.info.port=-1 2023-02-08 00:55:31,816 DEBUG [jenkins-hbase12:36763] assignment.AssignmentManager(2178): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-02-08 00:55:31,818 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 00:55:31,820 DEBUG [RS:0;jenkins-hbase12:36907] zookeeper.ZKUtil(162): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:31,821 WARN [RS:0;jenkins-hbase12:36907] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-02-08 00:55:31,822 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase12.apache.org,36907,1675817727419, state=OPENING 2023-02-08 00:55:31,822 INFO [RS:0;jenkins-hbase12:36907] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 00:55:31,823 DEBUG [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1947): logDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/WALs/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:31,824 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase12.apache.org,36907,1675817727419] 2023-02-08 00:55:31,855 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-02-08 00:55:31,856 DEBUG [RS:0;jenkins-hbase12:36907] zookeeper.ZKUtil(162): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:31,865 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 00:55:31,866 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 00:55:31,869 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:55:31,874 DEBUG [RS:0;jenkins-hbase12:36907] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-02-08 00:55:31,883 INFO [RS:0;jenkins-hbase12:36907] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-02-08 00:55:31,902 INFO [RS:0;jenkins-hbase12:36907] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-02-08 00:55:31,906 INFO [RS:0;jenkins-hbase12:36907] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:55:31,907 INFO [RS:0;jenkins-hbase12:36907] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:55:31,909 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer$CompactionChecker(1838): CompactionChecker runs every PT1S 2023-02-08 00:55:31,917 INFO [RS:0;jenkins-hbase12:36907] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-02-08 00:55:31,917 DEBUG [RS:0;jenkins-hbase12:36907] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 00:55:31,918 DEBUG [RS:0;jenkins-hbase12:36907] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 00:55:31,918 DEBUG [RS:0;jenkins-hbase12:36907] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 00:55:31,918 DEBUG [RS:0;jenkins-hbase12:36907] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 00:55:31,918 DEBUG [RS:0;jenkins-hbase12:36907] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 00:55:31,919 DEBUG [RS:0;jenkins-hbase12:36907] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase12:0, corePoolSize=2, maxPoolSize=2 2023-02-08 00:55:31,919 DEBUG [RS:0;jenkins-hbase12:36907] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 00:55:31,919 DEBUG [RS:0;jenkins-hbase12:36907] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 00:55:31,919 DEBUG [RS:0;jenkins-hbase12:36907] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 00:55:31,919 DEBUG [RS:0;jenkins-hbase12:36907] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase12:0, corePoolSize=1, maxPoolSize=1 2023-02-08 00:55:31,920 INFO [RS:0;jenkins-hbase12:36907] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 00:55:31,920 INFO [RS:0;jenkins-hbase12:36907] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-02-08 00:55:31,920 INFO [RS:0;jenkins-hbase12:36907] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-02-08 00:55:31,936 INFO [RS:0;jenkins-hbase12:36907] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-02-08 00:55:31,938 INFO [RS:0;jenkins-hbase12:36907] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,36907,1675817727419-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:55:31,951 INFO [RS:0;jenkins-hbase12:36907] regionserver.Replication(203): jenkins-hbase12.apache.org,36907,1675817727419 started 2023-02-08 00:55:31,951 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1638): Serving as jenkins-hbase12.apache.org,36907,1675817727419, RpcServer on jenkins-hbase12.apache.org/136.243.104.168:36907, sessionid=0x1014010f5da0001 2023-02-08 00:55:31,951 DEBUG [RS:0;jenkins-hbase12:36907] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-02-08 00:55:31,951 DEBUG [RS:0;jenkins-hbase12:36907] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:31,952 DEBUG [RS:0;jenkins-hbase12:36907] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase12.apache.org,36907,1675817727419' 2023-02-08 00:55:31,952 DEBUG [RS:0;jenkins-hbase12:36907] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:31,952 DEBUG [RS:0;jenkins-hbase12:36907] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:31,953 DEBUG [RS:0;jenkins-hbase12:36907] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-02-08 00:55:31,953 DEBUG [RS:0;jenkins-hbase12:36907] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-02-08 00:55:31,953 DEBUG [RS:0;jenkins-hbase12:36907] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:31,953 DEBUG [RS:0;jenkins-hbase12:36907] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase12.apache.org,36907,1675817727419' 2023-02-08 00:55:31,953 DEBUG [RS:0;jenkins-hbase12:36907] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 00:55:31,954 DEBUG [RS:0;jenkins-hbase12:36907] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 00:55:31,954 DEBUG [RS:0;jenkins-hbase12:36907] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-02-08 00:55:31,954 INFO [RS:0;jenkins-hbase12:36907] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-02-08 00:55:31,954 INFO [RS:0;jenkins-hbase12:36907] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-02-08 00:55:32,058 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:32,061 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 00:55:32,065 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:46540, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 00:55:32,066 INFO [RS:0;jenkins-hbase12:36907] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase12.apache.org%2C36907%2C1675817727419, suffix=, logDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/WALs/jenkins-hbase12.apache.org,36907,1675817727419, archiveDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/oldWALs, maxLogs=32 2023-02-08 00:55:32,078 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open hbase:meta,,1.1588230740 2023-02-08 00:55:32,078 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-02-08 00:55:32,082 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.AbstractFSWAL(464): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase12.apache.org%2C36907%2C1675817727419.meta, suffix=.meta, logDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/WALs/jenkins-hbase12.apache.org,36907,1675817727419, archiveDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/oldWALs, maxLogs=32 2023-02-08 00:55:32,090 DEBUG [RS-EventLoopGroup-3-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45165,DS-435253a9-76ab-4295-a971-e474cccc5f92,DISK] 2023-02-08 00:55:32,094 INFO [RS:0;jenkins-hbase12:36907] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/WALs/jenkins-hbase12.apache.org,36907,1675817727419/jenkins-hbase12.apache.org%2C36907%2C1675817727419.1675817732070 2023-02-08 00:55:32,094 DEBUG [RS:0;jenkins-hbase12:36907] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45165,DS-435253a9-76ab-4295-a971-e474cccc5f92,DISK]] 2023-02-08 00:55:32,101 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45165,DS-435253a9-76ab-4295-a971-e474cccc5f92,DISK] 2023-02-08 00:55:32,106 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.AbstractFSWAL(758): New WAL /user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/WALs/jenkins-hbase12.apache.org,36907,1675817727419/jenkins-hbase12.apache.org%2C36907%2C1675817727419.meta.1675817732084.meta 2023-02-08 00:55:32,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] wal.AbstractFSWAL(839): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45165,DS-435253a9-76ab-4295-a971-e474cccc5f92,DISK]] 2023-02-08 00:55:32,107 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:55:32,108 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-02-08 00:55:32,123 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(8546): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-02-08 00:55:32,127 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-02-08 00:55:32,132 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-02-08 00:55:32,132 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:55:32,132 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 1588230740 2023-02-08 00:55:32,132 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 1588230740 2023-02-08 00:55:32,134 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-02-08 00:55:32,136 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/info 2023-02-08 00:55:32,136 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/info 2023-02-08 00:55:32,137 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-02-08 00:55:32,137 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:55:32,138 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-02-08 00:55:32,139 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/rep_barrier 2023-02-08 00:55:32,139 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/rep_barrier 2023-02-08 00:55:32,139 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-02-08 00:55:32,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:55:32,140 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-02-08 00:55:32,142 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/table 2023-02-08 00:55:32,142 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/table 2023-02-08 00:55:32,142 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-02-08 00:55:32,143 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:55:32,144 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740 2023-02-08 00:55:32,146 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740 2023-02-08 00:55:32,149 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-02-08 00:55:32,151 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 1588230740 2023-02-08 00:55:32,152 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63773448, jitterRate=-0.049701571464538574}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-02-08 00:55:32,152 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 1588230740: Running coprocessor pre-open hook at 1675817732132Writing region info on filesystem at 1675817732132Initializing all the Stores at 1675817732134 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675817732134Instantiating store for column family {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} at 1675817732134Instantiating store for column family {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675817732134Cleaning up temporary data from old regions at 1675817732148 (+14 ms)Cleaning up detritus from prior splits at 1675817732148Running coprocessor post-open hooks at 1675817732152 (+4 ms)Region opened successfully at 1675817732152 2023-02-08 00:55:32,161 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1675817732051 2023-02-08 00:55:32,176 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:meta,,1.1588230740 2023-02-08 00:55:32,177 INFO [RS_OPEN_META-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened hbase:meta,,1.1588230740 2023-02-08 00:55:32,177 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase12.apache.org,36907,1675817727419, state=OPEN 2023-02-08 00:55:32,325 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-02-08 00:55:32,325 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-02-08 00:55:32,334 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-02-08 00:55:32,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase12.apache.org,36907,1675817727419 in 456 msec 2023-02-08 00:55:32,339 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-02-08 00:55:32,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 937 msec 2023-02-08 00:55:32,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.5120 sec 2023-02-08 00:55:32,345 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(946): Master startup: status=Wait for region servers to report in, state=RUNNING, startTime=1675817727975, completionTime=-1 2023-02-08 00:55:32,345 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-02-08 00:55:32,345 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(1519): Joining cluster... 2023-02-08 00:55:32,395 DEBUG [hconnection-0x4f03a38a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:55:32,398 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:46554, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:55:32,413 INFO [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(1531): Number of RegionServers=1 2023-02-08 00:55:32,413 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1675817792413 2023-02-08 00:55:32,413 INFO [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1675817852413 2023-02-08 00:55:32,413 INFO [master/jenkins-hbase12:0:becomeActiveMaster] assignment.AssignmentManager(1538): Joined the cluster in 67 msec 2023-02-08 00:55:32,775 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,36763,1675817725340-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:55:32,775 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,36763,1675817725340-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 00:55:32,775 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,36763,1675817725340-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 00:55:32,777 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase12:36763, period=300000, unit=MILLISECONDS is enabled. 2023-02-08 00:55:32,778 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-02-08 00:55:32,783 DEBUG [master/jenkins-hbase12:0.Chore.1] janitor.CatalogJanitor(175): 2023-02-08 00:55:32,790 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-02-08 00:55:32,791 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(2138): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-02-08 00:55:32,799 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-02-08 00:55:32,801 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 00:55:32,804 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 00:55:32,823 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/hbase/namespace/e60f76048dd578ad1c0ab31d5d11ddc7 2023-02-08 00:55:32,825 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/hbase/namespace/e60f76048dd578ad1c0ab31d5d11ddc7 empty. 2023-02-08 00:55:32,826 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/hbase/namespace/e60f76048dd578ad1c0ab31d5d11ddc7 2023-02-08 00:55:32,826 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-02-08 00:55:33,251 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-02-08 00:55:33,256 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7671): creating {ENCODED => e60f76048dd578ad1c0ab31d5d11ddc7, NAME => 'hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:55:33,677 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:55:33,677 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1603): Closing e60f76048dd578ad1c0ab31d5d11ddc7, disabling compactions & flushes 2023-02-08 00:55:33,677 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. 2023-02-08 00:55:33,677 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. 2023-02-08 00:55:33,677 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. after waiting 0 ms 2023-02-08 00:55:33,677 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. 2023-02-08 00:55:33,678 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. 2023-02-08 00:55:33,678 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1557): Region close journal for e60f76048dd578ad1c0ab31d5d11ddc7: Waiting for close lock at 1675817733677Disabling compacts and flushes for region at 1675817733677Disabling writes for close at 1675817733677Writing region close event to WAL at 1675817733678 (+1 ms)Closed at 1675817733678 2023-02-08 00:55:33,686 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 00:55:33,703 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675817733689"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817733689"}]},"ts":"1675817733689"} 2023-02-08 00:55:33,728 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 00:55:33,730 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 00:55:33,734 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817733730"}]},"ts":"1675817733730"} 2023-02-08 00:55:33,739 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-02-08 00:55:34,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e60f76048dd578ad1c0ab31d5d11ddc7, ASSIGN}] 2023-02-08 00:55:34,150 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e60f76048dd578ad1c0ab31d5d11ddc7, ASSIGN 2023-02-08 00:55:34,152 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e60f76048dd578ad1c0ab31d5d11ddc7, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:55:34,304 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e60f76048dd578ad1c0ab31d5d11ddc7, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:34,305 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675817734304"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817734304"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817734304"}]},"ts":"1675817734304"} 2023-02-08 00:55:34,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e60f76048dd578ad1c0ab31d5d11ddc7, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:55:34,480 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. 2023-02-08 00:55:34,481 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => e60f76048dd578ad1c0ab31d5d11ddc7, NAME => 'hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:55:34,482 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e60f76048dd578ad1c0ab31d5d11ddc7 2023-02-08 00:55:34,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:55:34,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for e60f76048dd578ad1c0ab31d5d11ddc7 2023-02-08 00:55:34,483 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for e60f76048dd578ad1c0ab31d5d11ddc7 2023-02-08 00:55:34,485 INFO [StoreOpener-e60f76048dd578ad1c0ab31d5d11ddc7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e60f76048dd578ad1c0ab31d5d11ddc7 2023-02-08 00:55:34,488 DEBUG [StoreOpener-e60f76048dd578ad1c0ab31d5d11ddc7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/namespace/e60f76048dd578ad1c0ab31d5d11ddc7/info 2023-02-08 00:55:34,488 DEBUG [StoreOpener-e60f76048dd578ad1c0ab31d5d11ddc7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/namespace/e60f76048dd578ad1c0ab31d5d11ddc7/info 2023-02-08 00:55:34,488 INFO [StoreOpener-e60f76048dd578ad1c0ab31d5d11ddc7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e60f76048dd578ad1c0ab31d5d11ddc7 columnFamilyName info 2023-02-08 00:55:34,489 INFO [StoreOpener-e60f76048dd578ad1c0ab31d5d11ddc7-1] regionserver.HStore(310): Store=e60f76048dd578ad1c0ab31d5d11ddc7/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:55:34,492 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/namespace/e60f76048dd578ad1c0ab31d5d11ddc7 2023-02-08 00:55:34,493 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/namespace/e60f76048dd578ad1c0ab31d5d11ddc7 2023-02-08 00:55:34,498 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for e60f76048dd578ad1c0ab31d5d11ddc7 2023-02-08 00:55:34,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/namespace/e60f76048dd578ad1c0ab31d5d11ddc7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:55:34,503 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened e60f76048dd578ad1c0ab31d5d11ddc7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64028050, jitterRate=-0.04590770602226257}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:55:34,503 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for e60f76048dd578ad1c0ab31d5d11ddc7: Running coprocessor pre-open hook at 1675817734483Writing region info on filesystem at 1675817734483Initializing all the Stores at 1675817734485 (+2 ms)Instantiating store for column family {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} at 1675817734485Cleaning up temporary data from old regions at 1675817734494 (+9 ms)Cleaning up detritus from prior splits at 1675817734494Running coprocessor post-open hooks at 1675817734503 (+9 ms)Region opened successfully at 1675817734503 2023-02-08 00:55:34,504 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7., pid=6, masterSystemTime=1675817734469 2023-02-08 00:55:34,508 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. 2023-02-08 00:55:34,509 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. 2023-02-08 00:55:34,510 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e60f76048dd578ad1c0ab31d5d11ddc7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:34,510 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1675817734509"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817734509"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817734509"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817734509"}]},"ts":"1675817734509"} 2023-02-08 00:55:34,518 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-02-08 00:55:34,518 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e60f76048dd578ad1c0ab31d5d11ddc7, server=jenkins-hbase12.apache.org,36907,1675817727419 in 198 msec 2023-02-08 00:55:34,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-02-08 00:55:34,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e60f76048dd578ad1c0ab31d5d11ddc7, ASSIGN in 371 msec 2023-02-08 00:55:34,523 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 00:55:34,523 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817734523"}]},"ts":"1675817734523"} 2023-02-08 00:55:34,526 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-02-08 00:55:34,778 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-02-08 00:55:34,779 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 00:55:34,784 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.9870 sec 2023-02-08 00:55:34,791 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-02-08 00:55:34,792 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 00:55:34,831 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-02-08 00:55:35,176 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 00:55:35,481 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 00:55:35,483 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-02-08 00:55:35,531 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 707 msec 2023-02-08 00:55:35,541 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-02-08 00:55:35,602 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 00:55:35,859 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 315 msec 2023-02-08 00:55:36,240 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-02-08 00:55:36,293 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-02-08 00:55:36,294 INFO [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(1077): Master has completed initialization 8.094sec 2023-02-08 00:55:36,296 INFO [master/jenkins-hbase12:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-02-08 00:55:36,299 INFO [master/jenkins-hbase12:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-02-08 00:55:36,299 INFO [master/jenkins-hbase12:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-02-08 00:55:36,300 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,36763,1675817725340-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-02-08 00:55:36,302 INFO [master/jenkins-hbase12:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase12.apache.org,36763,1675817725340-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-02-08 00:55:36,313 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster] master.HMaster(1166): Balancer post startup initialization complete, took 0 seconds 2023-02-08 00:55:36,384 DEBUG [Listener at localhost.localdomain/36213] zookeeper.ReadOnlyZKClient(139): Connect 0x014a46d9 to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:55:36,674 DEBUG [Listener at localhost.localdomain/36213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c0738cf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:55:36,694 DEBUG [hconnection-0x5249fc88-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:55:36,704 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:35666, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:55:36,715 INFO [Listener at localhost.localdomain/36213] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase12.apache.org,36763,1675817725340 2023-02-08 00:55:36,716 DEBUG [Listener at localhost.localdomain/36213] zookeeper.ReadOnlyZKClient(139): Connect 0x02632fa8 to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:55:36,756 DEBUG [Listener at localhost.localdomain/36213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b8bb120, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:55:36,756 INFO [Listener at localhost.localdomain/36213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 00:55:36,781 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=206, OpenFileDescriptor=475, MaxFileDescriptor=60000, SystemLoadAverage=379, ProcessCount=175, AvailableMemoryMB=3775 2023-02-08 00:55:36,786 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:36,787 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:36,794 DEBUG [Listener at localhost.localdomain/36213] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:55:36,798 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:46162, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:55:36,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-08 00:55:36,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:36,813 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 00:55:36,815 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 00:55:36,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-02-08 00:55:36,817 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:36,819 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2 empty. 2023-02-08 00:55:36,820 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:36,821 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-02-08 00:55:36,825 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:36,826 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:36,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-08 00:55:36,934 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:36,934 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:36,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-08 00:55:37,138 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:37,139 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:37,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-08 00:55:37,242 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-08 00:55:37,245 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 006ce3c661462075427cf7b5cb92f5d2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:55:37,263 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:55:37,263 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1603): Closing 006ce3c661462075427cf7b5cb92f5d2, disabling compactions & flushes 2023-02-08 00:55:37,263 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:37,263 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:37,263 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. after waiting 0 ms 2023-02-08 00:55:37,263 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:37,263 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:37,263 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1557): Region close journal for 006ce3c661462075427cf7b5cb92f5d2: Waiting for close lock at 1675817737263Disabling compacts and flushes for region at 1675817737263Disabling writes for close at 1675817737263Writing region close event to WAL at 1675817737263Closed at 1675817737263 2023-02-08 00:55:37,268 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 00:55:37,270 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675817737270"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817737270"}]},"ts":"1675817737270"} 2023-02-08 00:55:37,273 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 00:55:37,274 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 00:55:37,274 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817737274"}]},"ts":"1675817737274"} 2023-02-08 00:55:37,276 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-02-08 00:55:37,441 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:37,442 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:37,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-08 00:55:37,564 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=006ce3c661462075427cf7b5cb92f5d2, ASSIGN}] 2023-02-08 00:55:37,567 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=006ce3c661462075427cf7b5cb92f5d2, ASSIGN 2023-02-08 00:55:37,569 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=006ce3c661462075427cf7b5cb92f5d2, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:55:37,678 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:55:37,720 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=006ce3c661462075427cf7b5cb92f5d2, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:37,720 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675817737720"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817737720"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817737720"}]},"ts":"1675817737720"} 2023-02-08 00:55:37,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 006ce3c661462075427cf7b5cb92f5d2, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:55:37,884 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-02-08 00:55:37,888 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:37,888 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-02-08 00:55:37,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 006ce3c661462075427cf7b5cb92f5d2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:55:37,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:37,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:55:37,889 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:37,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:37,893 INFO [StoreOpener-006ce3c661462075427cf7b5cb92f5d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:37,896 DEBUG [StoreOpener-006ce3c661462075427cf7b5cb92f5d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1 2023-02-08 00:55:37,896 DEBUG [StoreOpener-006ce3c661462075427cf7b5cb92f5d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1 2023-02-08 00:55:37,899 INFO [StoreOpener-006ce3c661462075427cf7b5cb92f5d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 006ce3c661462075427cf7b5cb92f5d2 columnFamilyName family1 2023-02-08 00:55:37,902 INFO [StoreOpener-006ce3c661462075427cf7b5cb92f5d2-1] regionserver.HStore(310): Store=006ce3c661462075427cf7b5cb92f5d2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:55:37,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:37,905 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:37,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:37,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:55:37,915 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 006ce3c661462075427cf7b5cb92f5d2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68577558, jitterRate=0.02188524603843689}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:55:37,915 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 006ce3c661462075427cf7b5cb92f5d2: Running coprocessor pre-open hook at 1675817737890Writing region info on filesystem at 1675817737890Initializing all the Stores at 1675817737892 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675817737892Cleaning up temporary data from old regions at 1675817737906 (+14 ms)Cleaning up detritus from prior splits at 1675817737907 (+1 ms)Running coprocessor post-open hooks at 1675817737915 (+8 ms)Region opened successfully at 1675817737915 2023-02-08 00:55:37,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2., pid=11, masterSystemTime=1675817737877 2023-02-08 00:55:37,919 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:37,919 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:37,920 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=006ce3c661462075427cf7b5cb92f5d2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:37,921 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675817737920"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817737920"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817737920"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817737920"}]},"ts":"1675817737920"} 2023-02-08 00:55:37,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-02-08 00:55:37,927 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 006ce3c661462075427cf7b5cb92f5d2, server=jenkins-hbase12.apache.org,36907,1675817727419 in 201 msec 2023-02-08 00:55:37,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-02-08 00:55:37,930 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=006ce3c661462075427cf7b5cb92f5d2, ASSIGN in 363 msec 2023-02-08 00:55:37,931 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 00:55:37,931 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817737931"}]},"ts":"1675817737931"} 2023-02-08 00:55:37,933 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-02-08 00:55:37,947 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:37,947 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:37,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-08 00:55:38,014 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 00:55:38,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.2050 sec 2023-02-08 00:55:38,949 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:38,950 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:38,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=9 2023-02-08 00:55:38,954 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-02-08 00:55:38,973 DEBUG [hconnection-0x762acf0c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:55:38,976 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:35680, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:55:39,118 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:39,118 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:39,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:55:39,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:39,127 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:39,127 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:39,128 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 00:55:39,128 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 00:55:39,128 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:39,128 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:39,249 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:39,249 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:39,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:39,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:39,250 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:39,250 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:55:39,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:39,252 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:55:39,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:39,253 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:39,257 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:39,257 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 00:55:39,257 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:39,258 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 00:55:39,260 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:55:39,260 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:55:39,261 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:39,262 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. started... 2023-02-08 00:55:39,264 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ce3c661462075427cf7b5cb92f5d2 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-08 00:55:39,405 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113008c00378633d4969b6c231b99499e58e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113008c00378633d4969b6c231b99499e58e 2023-02-08 00:55:39,818 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/c5541e5559c346688b836753852cbb62 2023-02-08 00:55:39,834 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/c5541e5559c346688b836753852cbb62 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/c5541e5559c346688b836753852cbb62 2023-02-08 00:55:39,851 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/c5541e5559c346688b836753852cbb62, entries=1000, sequenceid=5, filesize=175.8 K 2023-02-08 00:55:39,854 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 006ce3c661462075427cf7b5cb92f5d2 in 589ms, sequenceid=5, compaction requested=false 2023-02-08 00:55:39,854 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:39,857 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:55:39,857 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:39,857 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:55:39,858 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:55:39,858 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:39,858 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 00:55:39,858 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 00:55:40,170 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,170 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:40,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:40,172 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,172 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:55:40,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:40,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:40,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:40,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 00:55:40,178 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 00:55:40,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@505d2097[Count = 0] remaining members to acquire global barrier 2023-02-08 00:55:40,178 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,196 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,197 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 00:55:40,197 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,197 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 00:55:40,197 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:55:40,197 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:55:40,208 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 00:55:40,208 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,208 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:40,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:40,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:40,208 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 00:55:40,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:40,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:40,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:40,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:55:40,212 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 00:55:40,212 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:55:40,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 00:55:40,212 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:55:40,212 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,212 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:55:40,518 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,518 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:40,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:40,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,519 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:40,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:40,521 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:40,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:40,522 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:40,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,526 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,544 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,544 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:40,544 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:40,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:40,544 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:40,544 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:40,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:40,544 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,544 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:55:40,544 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,545 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:40,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:40,545 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,545 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,546 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 00:55:40,546 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:55:40,647 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:55:40,647 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:40,648 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:40,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:55:40,663 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:40,664 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:40,665 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:55:40,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 00:55:40,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,671 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:40,671 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:40,672 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 00:55:40,672 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 00:55:40,672 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,673 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:40,997 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:40,997 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:40,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:40,999 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:40,999 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:55:40,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,000 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:55:41,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,001 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,001 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 00:55:41,002 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,002 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 00:55:41,002 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:41,003 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 00:55:41,003 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:55:41,003 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:55:41,003 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:41,003 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. started... 2023-02-08 00:55:41,004 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ce3c661462075427cf7b5cb92f5d2 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-08 00:55:41,039 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112822277e82d1494713ab103c42b138c255 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112822277e82d1494713ab103c42b138c255 2023-02-08 00:55:41,454 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/cfab8da00d2848a6a5de6240ee3eb044 2023-02-08 00:55:41,464 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/cfab8da00d2848a6a5de6240ee3eb044 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/cfab8da00d2848a6a5de6240ee3eb044 2023-02-08 00:55:41,472 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/cfab8da00d2848a6a5de6240ee3eb044, entries=1, sequenceid=9, filesize=5.0 K 2023-02-08 00:55:41,473 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 006ce3c661462075427cf7b5cb92f5d2 in 469ms, sequenceid=9, compaction requested=false 2023-02-08 00:55:41,474 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:55:41,474 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:41,474 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:55:41,474 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:55:41,474 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,474 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 00:55:41,474 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 00:55:41,544 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,544 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:41,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:41,545 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,545 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:55:41,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:41,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:41,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:41,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 00:55:41,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@ef79f63[Count = 0] remaining members to acquire global barrier 2023-02-08 00:55:41,550 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 00:55:41,550 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,564 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,565 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 00:55:41,565 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 00:55:41,565 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,565 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:55:41,565 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:55:41,603 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,603 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 00:55:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:41,604 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:41,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:41,604 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 00:55:41,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:41,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:41,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:41,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:55:41,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 00:55:41,608 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 00:55:41,608 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:55:41,608 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:55:41,608 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,608 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:55:41,886 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,886 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:41,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:41,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,887 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:41,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:41,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:41,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:41,890 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:41,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,893 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:41,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,953 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,953 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:41,953 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,953 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:41,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:55:41,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:41,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:41,953 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:41,953 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:41,953 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:41,954 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,954 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,954 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 00:55:41,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:41,955 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:41,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:41,955 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:55:42,055 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:55:42,055 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:42,056 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:42,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:55:42,071 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:42,072 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:42,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:55:42,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 00:55:42,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:42,080 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:42,080 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:42,080 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 00:55:42,080 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 00:55:42,081 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:42,081 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:42,391 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:42,391 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:42,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:42,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:42,392 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:42,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:42,392 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:55:42,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:42,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:55:42,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:42,394 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:42,395 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 00:55:42,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:42,395 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 00:55:42,395 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:42,396 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 00:55:42,396 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:55:42,396 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:55:42,396 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:42,396 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. started... 2023-02-08 00:55:42,397 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ce3c661462075427cf7b5cb92f5d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:55:42,427 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512010178cc338dcf43269827e7c8cbb92f7d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512010178cc338dcf43269827e7c8cbb92f7d 2023-02-08 00:55:42,840 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/e25a862d3b9647498315c7aefb58e6ee 2023-02-08 00:55:42,857 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/e25a862d3b9647498315c7aefb58e6ee as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/e25a862d3b9647498315c7aefb58e6ee 2023-02-08 00:55:42,866 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/e25a862d3b9647498315c7aefb58e6ee, entries=1, sequenceid=13, filesize=5.0 K 2023-02-08 00:55:42,867 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ce3c661462075427cf7b5cb92f5d2 in 470ms, sequenceid=13, compaction requested=true 2023-02-08 00:55:42,867 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:55:42,868 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:42,868 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:55:42,868 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:55:42,868 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:42,868 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 00:55:42,868 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 00:55:43,143 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,143 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:43,144 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,144 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:55:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:43,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:43,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:43,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 00:55:43,146 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41b9904[Count = 0] remaining members to acquire global barrier 2023-02-08 00:55:43,146 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 00:55:43,146 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,159 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,160 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,160 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:55:43,160 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 00:55:43,160 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 00:55:43,160 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:55:43,170 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 00:55:43,170 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,170 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:43,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:43,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:43,170 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 00:55:43,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:43,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:43,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:43,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:55:43,175 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 00:55:43,175 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 00:55:43,175 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:55:43,175 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:55:43,175 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,175 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:55:43,395 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:55:43,486 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,486 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,486 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:43,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:43,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:43,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:43,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:43,487 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:43,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:43,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,489 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:43,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,585 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,585 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:43,585 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,585 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,585 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:43,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:43,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:43,585 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:43,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:43,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:55:43,585 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,588 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,588 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,588 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,588 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-08 00:55:43,589 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 00:55:43,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:43,589 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:55:43,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:43,690 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:55:43,690 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:43,690 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:43,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:55:43,703 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:43,703 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:43,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:55:43,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 00:55:43,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,707 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:43,707 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:43,708 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 00:55:43,708 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 00:55:43,708 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,709 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,981 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:43,981 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:43,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:43,982 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:43,982 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:55:43,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:55:43,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,984 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,984 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 00:55:43,985 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:43,985 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 00:55:43,985 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:43,986 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 00:55:43,986 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:55:43,986 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:55:43,986 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:43,987 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. started... 2023-02-08 00:55:43,987 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ce3c661462075427cf7b5cb92f5d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:55:44,016 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052959fd3182f64c929cc0c98499c2078b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512052959fd3182f64c929cc0c98499c2078b 2023-02-08 00:55:44,428 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/562c851748604cd98c287b373a78f71b 2023-02-08 00:55:44,445 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/562c851748604cd98c287b373a78f71b as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/562c851748604cd98c287b373a78f71b 2023-02-08 00:55:44,454 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/562c851748604cd98c287b373a78f71b, entries=1, sequenceid=17, filesize=5.0 K 2023-02-08 00:55:44,455 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ce3c661462075427cf7b5cb92f5d2 in 468ms, sequenceid=17, compaction requested=true 2023-02-08 00:55:44,455 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:55:44,455 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:44,455 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:55:44,456 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:55:44,456 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:44,456 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 00:55:44,456 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 00:55:44,759 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:44,760 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:44,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:44,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:44,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:44,761 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:44,761 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:55:44,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:44,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:44,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:44,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:44,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:44,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 00:55:44,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e948ff1[Count = 0] remaining members to acquire global barrier 2023-02-08 00:55:44,766 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 00:55:44,767 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:44,780 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:44,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:44,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:44,780 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 00:55:44,781 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:44,781 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:55:44,781 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 00:55:44,781 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:55:44,791 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 00:55:44,791 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:44,791 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:44,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:44,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:44,791 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 00:55:44,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:44,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:44,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:44,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:44,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:44,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:44,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:44,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:44,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:55:44,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 00:55:44,796 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 00:55:44,796 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:55:44,796 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:55:44,796 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:44,796 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:55:45,086 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,086 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:45,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:45,086 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:45,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:45,087 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:45,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:45,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:45,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,091 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:45,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:45,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:45,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:45,112 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:45,112 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:45,112 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,112 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:45,112 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-08 00:55:45,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:45,113 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:55:45,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:45,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:45,112 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:45,113 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:45,113 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,113 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,113 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,113 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 00:55:45,114 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:55:45,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:45,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:45,214 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:55:45,214 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:45,214 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:45,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:55:45,224 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:45,224 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:45,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:55:45,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 00:55:45,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,229 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:45,230 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:45,230 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 00:55:45,230 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 00:55:45,231 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,231 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,523 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:45,523 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:45,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:45,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:45,524 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:45,524 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:55:45,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:55:45,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,528 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,529 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 00:55:45,529 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:45,530 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 00:55:45,530 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:45,531 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 00:55:45,532 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:55:45,532 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:55:45,532 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:45,532 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. started... 2023-02-08 00:55:45,532 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ce3c661462075427cf7b5cb92f5d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:55:45,962 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512283edbf727aa7f4f8d96c0c948ff55ed02 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512283edbf727aa7f4f8d96c0c948ff55ed02 2023-02-08 00:55:46,374 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/ac14f58dff4b433f9073deb16f718258 2023-02-08 00:55:46,387 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/ac14f58dff4b433f9073deb16f718258 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/ac14f58dff4b433f9073deb16f718258 2023-02-08 00:55:46,396 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/ac14f58dff4b433f9073deb16f718258, entries=1, sequenceid=21, filesize=5.0 K 2023-02-08 00:55:46,397 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ce3c661462075427cf7b5cb92f5d2 in 865ms, sequenceid=21, compaction requested=true 2023-02-08 00:55:46,398 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:55:46,398 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:46,398 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:55:46,398 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:55:46,398 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:46,398 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 00:55:46,398 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 00:55:46,794 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:46,794 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:46,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:46,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:46,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:46,795 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:46,795 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:55:46,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:46,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:46,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:46,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:46,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 00:55:46,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67f4452c[Count = 0] remaining members to acquire global barrier 2023-02-08 00:55:46,799 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 00:55:46,799 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:46,822 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:46,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:46,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:46,823 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:46,823 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:55:46,823 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 00:55:46,823 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 00:55:46,823 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:55:46,833 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 00:55:46,833 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:46,833 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:46,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:46,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:46,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:46,833 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 00:55:46,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:46,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:46,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:46,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:46,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:46,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:46,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:46,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:55:46,836 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 00:55:46,836 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 00:55:46,836 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:55:46,836 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:55:46,836 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:46,836 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:55:47,100 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,100 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,100 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:47,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:47,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:47,101 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:47,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:47,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:47,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:47,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,102 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:47,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:47,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:47,128 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:47,128 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:47,128 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:47,128 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-08 00:55:47,128 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:47,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:47,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:47,129 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:55:47,128 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:47,128 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,130 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:47,130 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,130 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,130 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:47,130 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,130 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 00:55:47,131 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:55:47,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:47,231 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:55:47,231 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:47,231 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:47,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:55:47,243 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:47,244 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:47,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:55:47,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 00:55:47,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,248 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:47,248 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:47,249 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 00:55:47,249 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 00:55:47,249 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,249 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,549 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:47,549 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:47,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:47,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:47,551 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:47,551 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:55:47,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:55:47,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,552 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,552 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 00:55:47,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:47,552 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 00:55:47,553 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:47,553 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 00:55:47,553 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:55:47,553 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:55:47,553 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:47,554 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. started... 2023-02-08 00:55:47,554 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ce3c661462075427cf7b5cb92f5d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:55:47,978 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311d92d8ee5c0c4af89e58112a16dcbdb1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512311d92d8ee5c0c4af89e58112a16dcbdb1 2023-02-08 00:55:48,389 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/d505f4172d244bf4bcc685976b524fbf 2023-02-08 00:55:48,404 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/d505f4172d244bf4bcc685976b524fbf as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/d505f4172d244bf4bcc685976b524fbf 2023-02-08 00:55:48,411 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/d505f4172d244bf4bcc685976b524fbf, entries=1, sequenceid=25, filesize=5.0 K 2023-02-08 00:55:48,412 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ce3c661462075427cf7b5cb92f5d2 in 858ms, sequenceid=25, compaction requested=true 2023-02-08 00:55:48,412 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:55:48,412 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:48,412 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:55:48,413 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:55:48,413 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:48,413 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 00:55:48,413 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 00:55:48,707 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:48,707 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:48,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:48,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:48,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:48,707 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:48,708 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:55:48,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:48,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:48,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:48,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:48,711 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 00:55:48,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@554ac236[Count = 0] remaining members to acquire global barrier 2023-02-08 00:55:48,712 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 00:55:48,712 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:48,727 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:48,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:48,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:48,728 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 00:55:48,728 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 00:55:48,728 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:55:48,728 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:48,728 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:55:48,738 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 00:55:48,738 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:48,738 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:48,738 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 00:55:48,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:48,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:48,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:48,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:48,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:48,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:48,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:48,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:48,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:48,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:48,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:55:48,743 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 00:55:48,743 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 00:55:48,743 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:55:48,743 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:55:48,743 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:48,743 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:55:49,033 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,033 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,034 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:49,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:49,034 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:49,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,036 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:49,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:49,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:49,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:49,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:49,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,039 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:49,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:49,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:49,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:49,139 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:49,139 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:49,139 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:49,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:49,139 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:49,140 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-08 00:55:49,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:49,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:55:49,139 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:49,139 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:49,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:49,143 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:49,143 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 00:55:49,143 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,144 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:55:49,144 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,144 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,244 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:55:49,244 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:49,245 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:49,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:55:49,256 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:49,256 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:49,257 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:55:49,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 00:55:49,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,261 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:49,261 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:49,261 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 00:55:49,261 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 00:55:49,262 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,262 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,570 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:49,570 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:49,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:49,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:49,571 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:49,571 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:55:49,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,573 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:55:49,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,575 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,575 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 00:55:49,575 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:49,576 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 00:55:49,576 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:49,577 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 00:55:49,577 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:55:49,577 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:55:49,577 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:49,577 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. started... 2023-02-08 00:55:49,577 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ce3c661462075427cf7b5cb92f5d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:55:50,002 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101257e0ff4f2cc431598df42ca86ebfe3f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101257e0ff4f2cc431598df42ca86ebfe3f 2023-02-08 00:55:50,013 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/d513d04a5ea94b328bb0d93599b12266 2023-02-08 00:55:50,023 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/d513d04a5ea94b328bb0d93599b12266 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/d513d04a5ea94b328bb0d93599b12266 2023-02-08 00:55:50,035 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/d513d04a5ea94b328bb0d93599b12266, entries=1, sequenceid=29, filesize=5.0 K 2023-02-08 00:55:50,036 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ce3c661462075427cf7b5cb92f5d2 in 459ms, sequenceid=29, compaction requested=true 2023-02-08 00:55:50,037 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:55:50,037 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:50,037 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:55:50,037 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:55:50,038 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,038 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 00:55:50,038 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 00:55:50,343 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,343 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:50,344 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,344 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:55:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:50,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 00:55:50,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d41b222[Count = 0] remaining members to acquire global barrier 2023-02-08 00:55:50,349 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 00:55:50,349 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,364 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,364 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 00:55:50,364 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 00:55:50,364 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,364 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:55:50,364 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:55:50,375 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 00:55:50,375 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,375 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:50,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:50,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:50,375 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 00:55:50,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:50,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:50,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:50,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:55:50,380 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 00:55:50,380 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 00:55:50,380 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:55:50,380 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:55:50,380 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,380 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:55:50,665 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,665 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:50,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:50,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,665 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:50,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:50,668 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:50,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,672 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:50,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,911 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,911 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:50,911 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:50,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:50,911 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:50,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:50,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:55:50,911 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:50,911 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,912 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:50,912 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,912 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:50,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:50,912 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:50,912 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 00:55:50,912 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:55:50,912 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:51,012 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:55:51,013 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:51,013 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:51,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:55:51,024 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:51,024 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:51,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:55:51,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 00:55:51,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:51,027 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:51,027 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:51,028 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 00:55:51,028 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 00:55:51,028 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:51,028 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:51,307 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:51,307 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:51,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:51,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:51,309 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:51,309 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:55:51,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:51,311 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:51,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:55:51,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:51,312 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:51,312 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 00:55:51,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:51,313 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 00:55:51,313 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:51,314 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 00:55:51,316 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:55:51,316 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:55:51,316 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:51,316 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. started... 2023-02-08 00:55:51,316 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ce3c661462075427cf7b5cb92f5d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:55:51,748 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010388af9904bb6f406fa91dbd2ac141a44c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010388af9904bb6f406fa91dbd2ac141a44c 2023-02-08 00:55:52,159 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/486408b749a047e686eab4d9c92df32d 2023-02-08 00:55:52,172 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/486408b749a047e686eab4d9c92df32d as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/486408b749a047e686eab4d9c92df32d 2023-02-08 00:55:52,181 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/486408b749a047e686eab4d9c92df32d, entries=1, sequenceid=33, filesize=5.0 K 2023-02-08 00:55:52,182 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ce3c661462075427cf7b5cb92f5d2 in 866ms, sequenceid=33, compaction requested=true 2023-02-08 00:55:52,182 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:55:52,182 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:52,182 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:55:52,183 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:55:52,183 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,183 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 00:55:52,183 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 00:55:52,490 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,490 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:52,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:52,491 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,491 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:55:52,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:52,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:52,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:52,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 00:55:52,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@77505f7c[Count = 0] remaining members to acquire global barrier 2023-02-08 00:55:52,492 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 00:55:52,492 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,533 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,533 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 00:55:52,533 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 00:55:52,533 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:55:52,534 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,534 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:55:52,663 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 00:55:52,663 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:52,663 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 00:55:52,663 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:52,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:52,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:52,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:52,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:52,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:55:52,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 00:55:52,674 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 00:55:52,674 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:55:52,674 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:55:52,674 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,674 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:55:52,754 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,754 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:52,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:52,754 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,754 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:52,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:52,756 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:52,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:52,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:52,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,759 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:52,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,785 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,785 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,785 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,785 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:52,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:52,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:55:52,785 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:52,785 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:52,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:52,785 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:52,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:52,786 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-08 00:55:52,786 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 00:55:52,787 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,787 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:55:52,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:52,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:52,787 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,887 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:55:52,887 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:52,888 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:52,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:55:52,896 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:52,897 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:52,898 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:55:52,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 00:55:52,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,901 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:52,901 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:52,902 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 00:55:52,902 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 00:55:52,902 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:52,902 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:53,200 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:53,200 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:53,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:53,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:53,201 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:53,201 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:55:53,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:53,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:53,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:55:53,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:53,204 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:53,205 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 00:55:53,205 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:53,205 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 00:55:53,205 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:53,206 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 00:55:53,206 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:55:53,206 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:55:53,207 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:53,207 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. started... 2023-02-08 00:55:53,207 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ce3c661462075427cf7b5cb92f5d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:55:53,639 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907348d00b729b6485a8e4f42ca6d973755 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907348d00b729b6485a8e4f42ca6d973755 2023-02-08 00:55:54,051 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/e625540a97e94aed8181ff306de6c9d2 2023-02-08 00:55:54,063 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/e625540a97e94aed8181ff306de6c9d2 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/e625540a97e94aed8181ff306de6c9d2 2023-02-08 00:55:54,071 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/e625540a97e94aed8181ff306de6c9d2, entries=1, sequenceid=37, filesize=5.0 K 2023-02-08 00:55:54,072 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ce3c661462075427cf7b5cb92f5d2 in 865ms, sequenceid=37, compaction requested=true 2023-02-08 00:55:54,072 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:55:54,072 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:54,072 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:55:54,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:55:54,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 00:55:54,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 00:55:54,336 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,336 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:54,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:54,337 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,337 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:55:54,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:54,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:54,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:54,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 00:55:54,341 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3248b99f[Count = 0] remaining members to acquire global barrier 2023-02-08 00:55:54,341 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 00:55:54,342 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,369 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,369 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,369 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 00:55:54,369 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 00:55:54,370 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:55:54,369 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,370 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:55:54,379 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 00:55:54,380 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,380 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:54,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:54,380 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 00:55:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:54,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:54,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:55:54,384 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 00:55:54,384 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:55:54,384 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:55:54,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 00:55:54,384 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,384 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:55:54,674 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,674 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:54,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,674 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:54,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:54,675 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:54,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,677 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:54,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:54,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:54,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:55:54,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:54,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-08 00:55:54,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:54,773 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:54,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,774 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:54,774 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 00:55:54,774 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,775 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:55:54,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:54,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:54,775 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,775 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,875 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:55:54,875 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:54,876 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:54,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:55:54,889 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:54,889 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:54,891 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:55:54,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-02-08 00:55:54,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,894 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:54,894 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:54,895 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-02-08 00:55:54,895 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-02-08 00:55:54,896 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:54,896 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:55,201 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:55,201 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:55,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:55,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:55,203 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:55,203 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:55:55,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:55,205 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:55,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:55:55,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:55,207 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:55,207 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-02-08 00:55:55,207 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:55,207 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-02-08 00:55:55,207 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:55:55,209 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-02-08 00:55:55,209 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:55:55,209 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:55:55,209 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:55,209 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. started... 2023-02-08 00:55:55,210 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 006ce3c661462075427cf7b5cb92f5d2 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:55:55,631 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511201abdf13dc63b490496eeb4e00f1dcb10 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511201abdf13dc63b490496eeb4e00f1dcb10 2023-02-08 00:55:56,041 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/5194f53455f348ad83bc4d69bd21d927 2023-02-08 00:55:56,348 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/5194f53455f348ad83bc4d69bd21d927 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/5194f53455f348ad83bc4d69bd21d927 2023-02-08 00:55:56,355 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/5194f53455f348ad83bc4d69bd21d927, entries=1, sequenceid=41, filesize=5.0 K 2023-02-08 00:55:56,356 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 006ce3c661462075427cf7b5cb92f5d2 in 1146ms, sequenceid=41, compaction requested=true 2023-02-08 00:55:56,356 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:55:56,356 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:56,356 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:55:56,357 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:55:56,357 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,357 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-02-08 00:55:56,357 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-02-08 00:55:56,407 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,407 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:56,407 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,407 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:55:56,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:56,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:56,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:56,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-02-08 00:55:56,412 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31909692[Count = 0] remaining members to acquire global barrier 2023-02-08 00:55:56,412 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-02-08 00:55:56,412 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,624 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,624 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-02-08 00:55:56,624 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-02-08 00:55:56,624 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:55:56,624 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,624 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:55:56,864 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,864 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-02-08 00:55:56,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:56,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:56,865 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:56,865 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-02-08 00:55:56,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:56,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:56,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:55:56,873 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-02-08 00:55:56,873 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-02-08 00:55:56,874 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:55:56,874 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:55:56,874 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,874 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:55:56,934 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,934 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,934 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:55:56,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:55:56,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:56,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:56,936 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:55:56,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:55:56,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,939 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:55:56,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,964 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:55:56,964 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,964 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:55:56,964 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:55:56,964 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:55:56,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-02-08 00:55:56,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:55:56,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:55:56,964 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,965 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,965 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-02-08 00:55:56,965 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:56,965 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,965 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-02-08 00:55:56,966 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:55:56,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:55:56,965 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:56,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:55:56,966 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:57,066 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:55:57,066 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:57,067 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:57,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:55:57,078 DEBUG [Listener at localhost.localdomain/36213] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 00:55:57,081 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:58918, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 00:55:57,082 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:57,095 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-08 00:55:57,096 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-08 00:55:57,098 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:55:57,098 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818357098 2023-02-08 00:55:57,099 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 00:55:57,104 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-08 00:55:57,104 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 00:55:57,104 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x13bc3a43 to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:55:57,414 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@275a7963, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:55:57,418 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:55:57,927 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031095a05f1d914ae094c81527bbb8e2d1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031095a05f1d914ae094c81527bbb8e2d1 2023-02-08 00:55:57,928 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 00:55:57,944 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:55:57,945 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:38570, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:55:57,956 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:57,956 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:57,957 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:55:57,958 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:58926, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:55:57,991 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f71968d9f51e433eb0063db120ee5b55 first=Optional[r3] last=Optional[r6] 2023-02-08 00:55:58,002 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f71968d9f51e433eb0063db120ee5b55}] 2023-02-08 00:55:58,018 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f71968d9f51e433eb0063db120ee5b55 for inclusion in 006ce3c661462075427cf7b5cb92f5d2/family1 2023-02-08 00:55:58,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-08 00:55:58,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:55:58,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:55:58,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f71968d9f51e433eb0063db120ee5b55 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l6ddf6jtl8h29jldl596c4314p43lkk9uq7ieh0gfis64lqffn2j542c44f44e65/family1/f71968d9f51e433eb0063db120ee5b55 2023-02-08 00:55:58,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l6ddf6jtl8h29jldl596c4314p43lkk9uq7ieh0gfis64lqffn2j542c44f44e65/family1/f71968d9f51e433eb0063db120ee5b55 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/719f5b38e8bc4a9eb79b4f6196c168c3_SeqId_44_ 2023-02-08 00:55:58,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l6ddf6jtl8h29jldl596c4314p43lkk9uq7ieh0gfis64lqffn2j542c44f44e65/family1/f71968d9f51e433eb0063db120ee5b55 into 006ce3c661462075427cf7b5cb92f5d2/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/719f5b38e8bc4a9eb79b4f6196c168c3_SeqId_44_ - updating store file list. 2023-02-08 00:55:58,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/719f5b38e8bc4a9eb79b4f6196c168c3_SeqId_44_ into 006ce3c661462075427cf7b5cb92f5d2/family1 2023-02-08 00:55:58,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l6ddf6jtl8h29jldl596c4314p43lkk9uq7ieh0gfis64lqffn2j542c44f44e65/family1/f71968d9f51e433eb0063db120ee5b55 into 006ce3c661462075427cf7b5cb92f5d2/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/719f5b38e8bc4a9eb79b4f6196c168c3_SeqId_44_) 2023-02-08 00:55:58,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__l6ddf6jtl8h29jldl596c4314p43lkk9uq7ieh0gfis64lqffn2j542c44f44e65/family1/f71968d9f51e433eb0063db120ee5b55 2023-02-08 00:55:58,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-08 00:55:58,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-08 00:55:58,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 006ce3c661462075427cf7b5cb92f5d2/family1 is initiating minor compaction 2023-02-08 00:55:58,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@732079cd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:55:58,051 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 006ce3c661462075427cf7b5cb92f5d2/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:58,052 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/cfab8da00d2848a6a5de6240ee3eb044, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/e25a862d3b9647498315c7aefb58e6ee, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/562c851748604cd98c287b373a78f71b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/ac14f58dff4b433f9073deb16f718258, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/d505f4172d244bf4bcc685976b524fbf, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/d513d04a5ea94b328bb0d93599b12266, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/486408b749a047e686eab4d9c92df32d, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/e625540a97e94aed8181ff306de6c9d2, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/5194f53455f348ad83bc4d69bd21d927, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/719f5b38e8bc4a9eb79b4f6196c168c3_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp, totalSize=50.2 K 2023-02-08 00:55:58,052 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting cfab8da00d2848a6a5de6240ee3eb044, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 00:55:58,053 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting e25a862d3b9647498315c7aefb58e6ee, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 00:55:58,053 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 562c851748604cd98c287b373a78f71b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-08 00:55:58,053 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting ac14f58dff4b433f9073deb16f718258, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-08 00:55:58,053 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting d505f4172d244bf4bcc685976b524fbf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-08 00:55:58,053 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting d513d04a5ea94b328bb0d93599b12266, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-08 00:55:58,053 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 486408b749a047e686eab4d9c92df32d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-08 00:55:58,054 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting e625540a97e94aed8181ff306de6c9d2, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-08 00:55:58,054 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 5194f53455f348ad83bc4d69bd21d927, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-08 00:55:58,054 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 719f5b38e8bc4a9eb79b4f6196c168c3_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-08 00:55:58,066 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 00:55:58,068 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:55:58,073 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512283edbf727aa7f4f8d96c0c948ff55ed02 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512283edbf727aa7f4f8d96c0c948ff55ed02 2023-02-08 00:55:58,074 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512311d92d8ee5c0c4af89e58112a16dcbdb1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512311d92d8ee5c0c4af89e58112a16dcbdb1 2023-02-08 00:55:58,076 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101257e0ff4f2cc431598df42ca86ebfe3f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101257e0ff4f2cc431598df42ca86ebfe3f 2023-02-08 00:55:58,077 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010388af9904bb6f406fa91dbd2ac141a44c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010388af9904bb6f406fa91dbd2ac141a44c 2023-02-08 00:55:58,077 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-02-08 00:55:58,077 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-08 00:55:58,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:55:58,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:55:58,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:55:58,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:55:58,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:55:58,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:55:58,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:55:58,078 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:55:58,113 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 006ce3c661462075427cf7b5cb92f5d2#family1#compaction#10 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:55:58,949 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/8f5f873bdbb4426dab7c47547e4979bc as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/8f5f873bdbb4426dab7c47547e4979bc 2023-02-08 00:55:58,968 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 006ce3c661462075427cf7b5cb92f5d2/family1 of 006ce3c661462075427cf7b5cb92f5d2 into 8f5f873bdbb4426dab7c47547e4979bc(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:55:58,968 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:55:58,970 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1675817758048; duration=0sec 2023-02-08 00:55:58,971 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:55:58,973 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053d3be8e8e37a49bf8f60e022dbc75220 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512053d3be8e8e37a49bf8f60e022dbc75220 2023-02-08 00:55:58,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 00:55:58,994 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:58,995 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:59,006 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e4d0c70c592e46738c3f5ea35460b57f first=Optional[r00] last=Optional[r2] 2023-02-08 00:55:59,007 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e4d0c70c592e46738c3f5ea35460b57f}] 2023-02-08 00:55:59,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e4d0c70c592e46738c3f5ea35460b57f for inclusion in 006ce3c661462075427cf7b5cb92f5d2/family1 2023-02-08 00:55:59,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-08 00:55:59,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:55:59,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:55:59,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e4d0c70c592e46738c3f5ea35460b57f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__4sutcav5lm4315kfi564nug7fe04jkv4darvn96s818m5gjovj3euhm13n6jg3ih/family1/e4d0c70c592e46738c3f5ea35460b57f 2023-02-08 00:55:59,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__4sutcav5lm4315kfi564nug7fe04jkv4darvn96s818m5gjovj3euhm13n6jg3ih/family1/e4d0c70c592e46738c3f5ea35460b57f as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/fe10e2b4cf604829b9fbc02678299f5e_SeqId_47_ 2023-02-08 00:55:59,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__4sutcav5lm4315kfi564nug7fe04jkv4darvn96s818m5gjovj3euhm13n6jg3ih/family1/e4d0c70c592e46738c3f5ea35460b57f into 006ce3c661462075427cf7b5cb92f5d2/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/fe10e2b4cf604829b9fbc02678299f5e_SeqId_47_ - updating store file list. 2023-02-08 00:55:59,032 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/cfab8da00d2848a6a5de6240ee3eb044, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/e25a862d3b9647498315c7aefb58e6ee, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/562c851748604cd98c287b373a78f71b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/ac14f58dff4b433f9073deb16f718258, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/d505f4172d244bf4bcc685976b524fbf, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/d513d04a5ea94b328bb0d93599b12266, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/486408b749a047e686eab4d9c92df32d, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/e625540a97e94aed8181ff306de6c9d2, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/5194f53455f348ad83bc4d69bd21d927, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/719f5b38e8bc4a9eb79b4f6196c168c3_SeqId_44_] to archive 2023-02-08 00:55:59,034 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:55:59,036 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/cfab8da00d2848a6a5de6240ee3eb044 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/cfab8da00d2848a6a5de6240ee3eb044 2023-02-08 00:55:59,038 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/e25a862d3b9647498315c7aefb58e6ee to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/e25a862d3b9647498315c7aefb58e6ee 2023-02-08 00:55:59,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/fe10e2b4cf604829b9fbc02678299f5e_SeqId_47_ into 006ce3c661462075427cf7b5cb92f5d2/family1 2023-02-08 00:55:59,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__4sutcav5lm4315kfi564nug7fe04jkv4darvn96s818m5gjovj3euhm13n6jg3ih/family1/e4d0c70c592e46738c3f5ea35460b57f into 006ce3c661462075427cf7b5cb92f5d2/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/fe10e2b4cf604829b9fbc02678299f5e_SeqId_47_) 2023-02-08 00:55:59,040 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/562c851748604cd98c287b373a78f71b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/562c851748604cd98c287b373a78f71b 2023-02-08 00:55:59,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__4sutcav5lm4315kfi564nug7fe04jkv4darvn96s818m5gjovj3euhm13n6jg3ih/family1/e4d0c70c592e46738c3f5ea35460b57f 2023-02-08 00:55:59,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 00:55:59,042 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/ac14f58dff4b433f9073deb16f718258 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/ac14f58dff4b433f9073deb16f718258 2023-02-08 00:55:59,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 00:55:59,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 006ce3c661462075427cf7b5cb92f5d2/family1 is initiating minor compaction (all files) 2023-02-08 00:55:59,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@45b6aa91; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:55:59,043 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 006ce3c661462075427cf7b5cb92f5d2/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:59,043 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/c5541e5559c346688b836753852cbb62, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/8f5f873bdbb4426dab7c47547e4979bc, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/fe10e2b4cf604829b9fbc02678299f5e_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp, totalSize=358.6 K 2023-02-08 00:55:59,043 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting c5541e5559c346688b836753852cbb62, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878836759 2023-02-08 00:55:59,044 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/d505f4172d244bf4bcc685976b524fbf to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/d505f4172d244bf4bcc685976b524fbf 2023-02-08 00:55:59,044 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 8f5f873bdbb4426dab7c47547e4979bc, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621236759 2023-02-08 00:55:59,044 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting fe10e2b4cf604829b9fbc02678299f5e_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878836759 2023-02-08 00:55:59,046 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/d513d04a5ea94b328bb0d93599b12266 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/d513d04a5ea94b328bb0d93599b12266 2023-02-08 00:55:59,046 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 00:55:59,047 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:55:59,048 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/486408b749a047e686eab4d9c92df32d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/486408b749a047e686eab4d9c92df32d 2023-02-08 00:55:59,049 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/e625540a97e94aed8181ff306de6c9d2 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/e625540a97e94aed8181ff306de6c9d2 2023-02-08 00:55:59,049 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113008c00378633d4969b6c231b99499e58e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015113008c00378633d4969b6c231b99499e58e 2023-02-08 00:55:59,051 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512010178cc338dcf43269827e7c8cbb92f7d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512010178cc338dcf43269827e7c8cbb92f7d 2023-02-08 00:55:59,051 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/5194f53455f348ad83bc4d69bd21d927 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/5194f53455f348ad83bc4d69bd21d927 2023-02-08 00:55:59,052 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512052959fd3182f64c929cc0c98499c2078b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512052959fd3182f64c929cc0c98499c2078b 2023-02-08 00:55:59,052 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-02-08 00:55:59,053 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-08 00:55:59,053 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/719f5b38e8bc4a9eb79b4f6196c168c3_SeqId_44_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/719f5b38e8bc4a9eb79b4f6196c168c3_SeqId_44_ 2023-02-08 00:55:59,053 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:55:59,053 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 00:55:59,053 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:55:59,054 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-08 00:55:59,056 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.9670 sec 2023-02-08 00:55:59,097 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 006ce3c661462075427cf7b5cb92f5d2#family1#compaction#11 average throughput is 4.24 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:55:59,137 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/.tmp/family1/7b843fcd61c74b84b3694ca4bf507018 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/7b843fcd61c74b84b3694ca4bf507018 2023-02-08 00:55:59,148 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 006ce3c661462075427cf7b5cb92f5d2/family1 of 006ce3c661462075427cf7b5cb92f5d2 into 7b843fcd61c74b84b3694ca4bf507018(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:55:59,148 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:55:59,148 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1675817759042; duration=0sec 2023-02-08 00:55:59,148 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:55:59,220 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/c5541e5559c346688b836753852cbb62, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/8f5f873bdbb4426dab7c47547e4979bc, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/fe10e2b4cf604829b9fbc02678299f5e_SeqId_47_] to archive 2023-02-08 00:55:59,222 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:55:59,223 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/c5541e5559c346688b836753852cbb62 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/c5541e5559c346688b836753852cbb62 2023-02-08 00:55:59,226 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/8f5f873bdbb4426dab7c47547e4979bc to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/8f5f873bdbb4426dab7c47547e4979bc 2023-02-08 00:55:59,227 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/fe10e2b4cf604829b9fbc02678299f5e_SeqId_47_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/fe10e2b4cf604829b9fbc02678299f5e_SeqId_47_ 2023-02-08 00:55:59,230 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:59,230 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:59,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-08 00:55:59,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:59,263 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-08 00:55:59,264 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-02-08 00:55:59,265 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-02-08 00:55:59,269 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-02-08 00:55:59,283 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=006ce3c661462075427cf7b5cb92f5d2, REOPEN/MOVE}] 2023-02-08 00:55:59,285 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=006ce3c661462075427cf7b5cb92f5d2, REOPEN/MOVE 2023-02-08 00:55:59,286 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=006ce3c661462075427cf7b5cb92f5d2, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:59,286 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675817759286"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817759286"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817759286"}]},"ts":"1675817759286"} 2023-02-08 00:55:59,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 006ce3c661462075427cf7b5cb92f5d2, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:55:59,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:59,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 006ce3c661462075427cf7b5cb92f5d2, disabling compactions & flushes 2023-02-08 00:55:59,450 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:59,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:59,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. after waiting 0 ms 2023-02-08 00:55:59,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:59,459 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-08 00:55:59,461 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:59,461 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 006ce3c661462075427cf7b5cb92f5d2: Waiting for close lock at 1675817759450Running coprocessor pre-close hooks at 1675817759450Disabling compacts and flushes for region at 1675817759450Disabling writes for close at 1675817759450Writing region close event to WAL at 1675817759453 (+3 ms)Running coprocessor post-close hooks at 1675817759460 (+7 ms)Closed at 1675817759461 (+1 ms) 2023-02-08 00:55:59,461 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 006ce3c661462075427cf7b5cb92f5d2 to self. 2023-02-08 00:55:59,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:59,464 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=006ce3c661462075427cf7b5cb92f5d2, regionState=CLOSED 2023-02-08 00:55:59,465 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675817759464"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817759464"}]},"ts":"1675817759464"} 2023-02-08 00:55:59,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=15 2023-02-08 00:55:59,470 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 006ce3c661462075427cf7b5cb92f5d2, server=jenkins-hbase12.apache.org,36907,1675817727419 in 178 msec 2023-02-08 00:55:59,471 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=006ce3c661462075427cf7b5cb92f5d2, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=true 2023-02-08 00:55:59,621 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=006ce3c661462075427cf7b5cb92f5d2, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:59,622 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675817759621"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817759621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817759621"}]},"ts":"1675817759621"} 2023-02-08 00:55:59,626 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 006ce3c661462075427cf7b5cb92f5d2, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:55:59,787 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:59,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 006ce3c661462075427cf7b5cb92f5d2, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:55:59,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:59,788 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:55:59,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:59,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:59,792 INFO [StoreOpener-006ce3c661462075427cf7b5cb92f5d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:59,794 DEBUG [StoreOpener-006ce3c661462075427cf7b5cb92f5d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1 2023-02-08 00:55:59,794 DEBUG [StoreOpener-006ce3c661462075427cf7b5cb92f5d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1 2023-02-08 00:55:59,795 INFO [StoreOpener-006ce3c661462075427cf7b5cb92f5d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 006ce3c661462075427cf7b5cb92f5d2 columnFamilyName family1 2023-02-08 00:55:59,807 DEBUG [StoreOpener-006ce3c661462075427cf7b5cb92f5d2-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/7b843fcd61c74b84b3694ca4bf507018 2023-02-08 00:55:59,807 INFO [StoreOpener-006ce3c661462075427cf7b5cb92f5d2-1] regionserver.HStore(310): Store=006ce3c661462075427cf7b5cb92f5d2/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:55:59,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:59,811 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:59,816 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 006ce3c661462075427cf7b5cb92f5d2 2023-02-08 00:55:59,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 006ce3c661462075427cf7b5cb92f5d2; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66439041, jitterRate=-0.009981140494346619}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:55:59,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 006ce3c661462075427cf7b5cb92f5d2: Running coprocessor pre-open hook at 1675817759789Writing region info on filesystem at 1675817759789Initializing all the Stores at 1675817759791 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675817759792 (+1 ms)Cleaning up temporary data from old regions at 1675817759812 (+20 ms)Cleaning up detritus from prior splits at 1675817759813 (+1 ms)Running coprocessor post-open hooks at 1675817759817 (+4 ms)Region opened successfully at 1675817759817 2023-02-08 00:55:59,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2., pid=17, masterSystemTime=1675817759780 2023-02-08 00:55:59,821 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:59,821 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 00:55:59,822 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=006ce3c661462075427cf7b5cb92f5d2, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:55:59,822 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1675817759822"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817759822"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817759822"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817759822"}]},"ts":"1675817759822"} 2023-02-08 00:55:59,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=17, resume processing ppid=15 2023-02-08 00:55:59,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 006ce3c661462075427cf7b5cb92f5d2, server=jenkins-hbase12.apache.org,36907,1675817727419 in 199 msec 2023-02-08 00:55:59,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-02-08 00:55:59,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=006ce3c661462075427cf7b5cb92f5d2, REOPEN/MOVE in 544 msec 2023-02-08 00:55:59,833 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=14, resume processing ppid=13 2023-02-08 00:55:59,834 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 563 msec 2023-02-08 00:55:59,836 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 594 msec 2023-02-08 00:55:59,838 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:59,838 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:59,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=13 2023-02-08 00:55:59,840 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:59,840 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:59,846 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:55:59,846 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:55:59,847 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(278): alter status finished 2023-02-08 00:55:59,848 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-02-08 00:55:59,850 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-08 00:55:59,851 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-08 00:55:59,852 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:55:59,852 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818359852 2023-02-08 00:55:59,853 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 00:55:59,854 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-02-08 00:55:59,854 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 00:55:59,855 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x423255da to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:56:00,118 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@55c58f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:56:00,119 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:56:00,119 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:56:00,119 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:56:00,119 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:56:00,120 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:56:00,968 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128258ac1163888493487374b5ae83d5c2d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128258ac1163888493487374b5ae83d5c2d 2023-02-08 00:56:00,969 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 00:56:00,986 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:56:00,987 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:38578, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:56:00,994 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:00,994 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:00,995 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:56:00,997 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:58930, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:56:01,010 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/89ac8cd010ad43f180aa3a9673c90500 first=Optional[r05] last=Optional[r8] 2023-02-08 00:56:01,010 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/89ac8cd010ad43f180aa3a9673c90500}] 2023-02-08 00:56:01,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/89ac8cd010ad43f180aa3a9673c90500 for inclusion in 006ce3c661462075427cf7b5cb92f5d2/family1 2023-02-08 00:56:01,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-08 00:56:01,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:56:01,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 006ce3c661462075427cf7b5cb92f5d2: 2023-02-08 00:56:01,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/89ac8cd010ad43f180aa3a9673c90500 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__hpeckme96cem7mp9d101e9bkgr8eltptlov81bi67qo5n7vv426r29ec01jju3pc/family1/89ac8cd010ad43f180aa3a9673c90500 2023-02-08 00:56:01,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__hpeckme96cem7mp9d101e9bkgr8eltptlov81bi67qo5n7vv426r29ec01jju3pc/family1/89ac8cd010ad43f180aa3a9673c90500 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/efcc88b7cd664df58e9ab66cf4dd6558_SeqId_53_ 2023-02-08 00:56:01,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__hpeckme96cem7mp9d101e9bkgr8eltptlov81bi67qo5n7vv426r29ec01jju3pc/family1/89ac8cd010ad43f180aa3a9673c90500 into 006ce3c661462075427cf7b5cb92f5d2/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/efcc88b7cd664df58e9ab66cf4dd6558_SeqId_53_ - updating store file list. 2023-02-08 00:56:01,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/efcc88b7cd664df58e9ab66cf4dd6558_SeqId_53_ into 006ce3c661462075427cf7b5cb92f5d2/family1 2023-02-08 00:56:01,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__hpeckme96cem7mp9d101e9bkgr8eltptlov81bi67qo5n7vv426r29ec01jju3pc/family1/89ac8cd010ad43f180aa3a9673c90500 into 006ce3c661462075427cf7b5cb92f5d2/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/family1/efcc88b7cd664df58e9ab66cf4dd6558_SeqId_53_) 2023-02-08 00:56:01,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__hpeckme96cem7mp9d101e9bkgr8eltptlov81bi67qo5n7vv426r29ec01jju3pc/family1/89ac8cd010ad43f180aa3a9673c90500 2023-02-08 00:56:01,033 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 00:56:01,034 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:56:01,036 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511201abdf13dc63b490496eeb4e00f1dcb10 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511201abdf13dc63b490496eeb4e00f1dcb10 2023-02-08 00:56:01,037 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112822277e82d1494713ab103c42b138c255 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112822277e82d1494713ab103c42b138c255 2023-02-08 00:56:01,037 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-02-08 00:56:01,037 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-08 00:56:01,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:56:01,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:56:01,037 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-02-08 00:56:01,037 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-02-08 00:56:01,038 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:56:01,038 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-02-08 00:56:01,040 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.1890 sec 2023-02-08 00:56:01,133 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=241 (was 206) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49726@0x423255da-SendThread(127.0.0.1:49726) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: hconnection-0xe18a4fa-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1137145960_15 at /127.0.0.1:52170 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1137145960_15 at /127.0.0.1:52078 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1137145960_15 at /127.0.0.1:52042 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49726@0x423255da sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/549296890.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1137145960_15 at /127.0.0.1:52098 [Waiting for operation #29] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1137145960_15 at /127.0.0.1:52158 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49726@0x423255da-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS:0;jenkins-hbase12:36907-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49726@0x13bc3a43-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1137145960_15 at /127.0.0.1:52130 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49726@0x13bc3a43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$45/549296890.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:49726@0x13bc3a43-SendThread(127.0.0.1:49726) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f5e706f-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe18a4fa-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1137145960_15 at /127.0.0.1:52214 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1137145960_15 at /127.0.0.1:52270 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1137145960_15 at /127.0.0.1:52180 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1137145960_15 at /127.0.0.1:52308 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2f5e706f-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1420783991_15 at /127.0.0.1:52146 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1137145960_15 at /127.0.0.1:52200 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe18a4fa-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=576 (was 475) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=341 (was 379), ProcessCount=175 (was 175), AvailableMemoryMB=3649 (was 3775) 2023-02-08 00:56:01,146 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=241, OpenFileDescriptor=576, MaxFileDescriptor=60000, SystemLoadAverage=341, ProcessCount=175, AvailableMemoryMB=3647 2023-02-08 00:56:01,147 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:01,147 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:01,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-08 00:56:01,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:01,152 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 00:56:01,152 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-02-08 00:56:01,153 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:01,153 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:01,153 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 00:56:01,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-08 00:56:01,155 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f 2023-02-08 00:56:01,155 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f empty. 2023-02-08 00:56:01,156 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f 2023-02-08 00:56:01,156 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-02-08 00:56:01,254 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:01,254 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:01,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-08 00:56:01,456 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:01,457 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:01,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-08 00:56:01,568 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-08 00:56:01,571 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 2caf1b6dbcce2bc4cc85ec18a74d129f, NAME => 'testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:56:01,582 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:56:01,582 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing 2caf1b6dbcce2bc4cc85ec18a74d129f, disabling compactions & flushes 2023-02-08 00:56:01,582 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:01,582 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:01,582 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. after waiting 0 ms 2023-02-08 00:56:01,582 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:01,582 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:01,582 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: Waiting for close lock at 1675817761582Disabling compacts and flushes for region at 1675817761582Disabling writes for close at 1675817761582Writing region close event to WAL at 1675817761582Closed at 1675817761582 2023-02-08 00:56:01,585 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 00:56:01,586 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675817761586"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817761586"}]},"ts":"1675817761586"} 2023-02-08 00:56:01,588 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 00:56:01,589 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 00:56:01,589 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817761589"}]},"ts":"1675817761589"} 2023-02-08 00:56:01,591 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-08 00:56:01,759 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:01,760 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:01,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-08 00:56:01,959 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=2caf1b6dbcce2bc4cc85ec18a74d129f, ASSIGN}] 2023-02-08 00:56:01,963 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=2caf1b6dbcce2bc4cc85ec18a74d129f, ASSIGN 2023-02-08 00:56:01,965 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=2caf1b6dbcce2bc4cc85ec18a74d129f, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:56:02,117 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2caf1b6dbcce2bc4cc85ec18a74d129f, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:02,118 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675817762117"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817762117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817762117"}]},"ts":"1675817762117"} 2023-02-08 00:56:02,123 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 2caf1b6dbcce2bc4cc85ec18a74d129f, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:56:02,263 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:02,263 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:02,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-08 00:56:02,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:02,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2caf1b6dbcce2bc4cc85ec18a74d129f, NAME => 'testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:56:02,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 2caf1b6dbcce2bc4cc85ec18a74d129f 2023-02-08 00:56:02,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:56:02,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 2caf1b6dbcce2bc4cc85ec18a74d129f 2023-02-08 00:56:02,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 2caf1b6dbcce2bc4cc85ec18a74d129f 2023-02-08 00:56:02,287 INFO [StoreOpener-2caf1b6dbcce2bc4cc85ec18a74d129f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2caf1b6dbcce2bc4cc85ec18a74d129f 2023-02-08 00:56:02,289 DEBUG [StoreOpener-2caf1b6dbcce2bc4cc85ec18a74d129f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1 2023-02-08 00:56:02,289 DEBUG [StoreOpener-2caf1b6dbcce2bc4cc85ec18a74d129f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1 2023-02-08 00:56:02,290 INFO [StoreOpener-2caf1b6dbcce2bc4cc85ec18a74d129f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2caf1b6dbcce2bc4cc85ec18a74d129f columnFamilyName family1 2023-02-08 00:56:02,292 INFO [StoreOpener-2caf1b6dbcce2bc4cc85ec18a74d129f-1] regionserver.HStore(310): Store=2caf1b6dbcce2bc4cc85ec18a74d129f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:56:02,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f 2023-02-08 00:56:02,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f 2023-02-08 00:56:02,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 2caf1b6dbcce2bc4cc85ec18a74d129f 2023-02-08 00:56:02,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:56:02,301 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 2caf1b6dbcce2bc4cc85ec18a74d129f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65965117, jitterRate=-0.017043158411979675}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:56:02,301 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: Running coprocessor pre-open hook at 1675817762285Writing region info on filesystem at 1675817762285Initializing all the Stores at 1675817762286 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675817762286Cleaning up temporary data from old regions at 1675817762295 (+9 ms)Cleaning up detritus from prior splits at 1675817762296 (+1 ms)Running coprocessor post-open hooks at 1675817762301 (+5 ms)Region opened successfully at 1675817762301 2023-02-08 00:56:02,302 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f., pid=21, masterSystemTime=1675817762276 2023-02-08 00:56:02,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:02,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:02,304 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=2caf1b6dbcce2bc4cc85ec18a74d129f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:02,304 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675817762304"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817762304"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817762304"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817762304"}]},"ts":"1675817762304"} 2023-02-08 00:56:02,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=21, resume processing ppid=20 2023-02-08 00:56:02,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 2caf1b6dbcce2bc4cc85ec18a74d129f, server=jenkins-hbase12.apache.org,36907,1675817727419 in 183 msec 2023-02-08 00:56:02,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=20, resume processing ppid=19 2023-02-08 00:56:02,311 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=2caf1b6dbcce2bc4cc85ec18a74d129f, ASSIGN in 349 msec 2023-02-08 00:56:02,312 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 00:56:02,312 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817762312"}]},"ts":"1675817762312"} 2023-02-08 00:56:02,313 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-08 00:56:02,615 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 00:56:02,619 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 1.4660 sec 2023-02-08 00:56:03,266 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:03,267 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:03,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=19 2023-02-08 00:56:03,269 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-02-08 00:56:03,306 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:03,306 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:03,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:03,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:03,313 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:03,313 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:03,313 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:56:03,313 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:03,314 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:03,314 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:03,621 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:03,621 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:03,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:03,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:03,622 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:03,622 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:03,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:03,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:03,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:03,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:03,624 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:03,624 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:03,624 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:56:03,624 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:03,625 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:56:03,625 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:03,625 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:03,625 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:03,626 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. started... 2023-02-08 00:56:03,626 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2caf1b6dbcce2bc4cc85ec18a74d129f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-08 00:56:04,057 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511300f4c583bfce041fb8bdaf65fa2d8b639 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511300f4c583bfce041fb8bdaf65fa2d8b639 2023-02-08 00:56:04,463 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/5f9da23ff90e47d7b94ffb231fae6e45 2023-02-08 00:56:04,472 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/5f9da23ff90e47d7b94ffb231fae6e45 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/5f9da23ff90e47d7b94ffb231fae6e45 2023-02-08 00:56:04,482 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/5f9da23ff90e47d7b94ffb231fae6e45, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-08 00:56:04,484 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 2caf1b6dbcce2bc4cc85ec18a74d129f in 858ms, sequenceid=5, compaction requested=false 2023-02-08 00:56:04,484 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:04,485 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:04,485 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:04,485 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:04,485 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:04,485 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:04,485 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:56:04,485 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:56:04,869 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:04,869 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:04,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:04,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:04,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:04,869 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:04,869 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:04,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:04,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:04,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:04,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:04,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:04,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:56:04,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3140f220[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:04,872 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:04,872 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:04,962 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:04,962 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:04,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:04,962 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:04,962 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:56:04,962 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:04,962 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:04,962 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:04,998 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:56:05,031 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:56:05,031 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:05,031 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:05,031 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:56:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:05,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:05,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:05,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:05,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:05,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:05,035 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:56:05,035 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:05,035 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:05,035 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,035 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:05,316 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,316 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:05,316 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:05,318 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:05,318 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:05,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:05,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,323 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:05,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:05,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:05,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:05,585 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:05,585 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:05,585 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:05,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:05,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:05,585 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:05,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:05,586 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:05,586 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,587 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:05,589 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:05,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:05,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:05,588 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,589 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:05,590 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,590 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,590 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,689 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:05,689 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:05,690 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:05,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:05,699 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:05,699 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:05,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:05,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:05,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,703 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:05,703 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:05,704 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:56:05,704 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:05,704 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,704 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,774 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:05,774 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:05,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:05,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:05,775 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:05,775 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:05,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,776 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:05,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,776 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,777 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:56:05,777 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:05,777 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:56:05,777 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:05,777 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:56:05,778 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:05,778 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:05,778 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:05,778 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. started... 2023-02-08 00:56:05,778 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2caf1b6dbcce2bc4cc85ec18a74d129f 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-08 00:56:06,206 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511286546f5f094e347f39462498955490eb4 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511286546f5f094e347f39462498955490eb4 2023-02-08 00:56:06,617 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/3542017e5e634fdf9cc22a2a7adf7023 2023-02-08 00:56:06,630 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/3542017e5e634fdf9cc22a2a7adf7023 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/3542017e5e634fdf9cc22a2a7adf7023 2023-02-08 00:56:06,639 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/3542017e5e634fdf9cc22a2a7adf7023, entries=1, sequenceid=9, filesize=5.0 K 2023-02-08 00:56:06,640 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 2caf1b6dbcce2bc4cc85ec18a74d129f in 862ms, sequenceid=9, compaction requested=false 2023-02-08 00:56:06,640 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:06,640 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:06,640 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:06,640 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:06,640 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:06,640 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:56:06,640 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:56:07,033 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,033 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:07,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:07,034 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,034 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:07,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:07,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:07,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:07,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:56:07,040 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@449ef0cb[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:07,040 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:07,041 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,095 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,095 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:07,095 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:56:07,095 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:07,096 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,096 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:07,159 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:56:07,159 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:07,159 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,159 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:56:07,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:07,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:07,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:07,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:07,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:07,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:07,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:07,168 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:56:07,168 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:07,168 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:07,168 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,168 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:07,195 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,195 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,195 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:07,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:07,195 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:07,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:07,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,198 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:07,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,559 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:07,559 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,559 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:07,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:07,559 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:07,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:07,559 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:56:07,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:07,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:07,559 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,561 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,561 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:07,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:07,561 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:07,561 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,561 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:07,561 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,561 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,661 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:07,662 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:07,662 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:07,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:07,670 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:07,670 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:07,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:07,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:07,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,675 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:07,675 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:07,676 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:56:07,676 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:07,676 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,676 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,985 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:07,985 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:07,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:07,987 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:07,987 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:07,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,988 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:07,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,988 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,989 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:56:07,989 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:07,989 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:56:07,989 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:07,990 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:56:07,990 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:07,990 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:07,990 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:07,990 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. started... 2023-02-08 00:56:07,990 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2caf1b6dbcce2bc4cc85ec18a74d129f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:08,414 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201b8824a3c3adc48388fc7ff456fa52722 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201b8824a3c3adc48388fc7ff456fa52722 2023-02-08 00:56:08,824 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/37b8a7c07cc24c6d92015f07e65b6f32 2023-02-08 00:56:08,838 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/37b8a7c07cc24c6d92015f07e65b6f32 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/37b8a7c07cc24c6d92015f07e65b6f32 2023-02-08 00:56:08,843 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/37b8a7c07cc24c6d92015f07e65b6f32, entries=1, sequenceid=13, filesize=4.9 K 2023-02-08 00:56:08,844 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2caf1b6dbcce2bc4cc85ec18a74d129f in 854ms, sequenceid=13, compaction requested=true 2023-02-08 00:56:08,844 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:08,845 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:08,845 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:08,845 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:08,845 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:08,845 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:56:08,845 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:56:09,157 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,157 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:09,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:09,158 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,158 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:09,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:09,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:09,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:09,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:56:09,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@336d2d86[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:09,162 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:09,162 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,178 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,178 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,179 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:09,179 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:56:09,179 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:09,179 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,179 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:09,189 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:56:09,189 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,189 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:09,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:09,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:09,189 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:56:09,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:09,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:09,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:09,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:09,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:09,193 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:56:09,193 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:09,193 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:09,193 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,193 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:09,470 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,470 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:09,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:09,470 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,470 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:09,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,472 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:09,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:09,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:09,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:09,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,475 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:09,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,515 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:09,515 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,515 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:09,515 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:09,515 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:09,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:09,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:09,515 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,516 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,516 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:56:09,516 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,516 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:09,516 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,516 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:09,516 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:09,517 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,517 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:09,617 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:09,617 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:09,617 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:09,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:09,626 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:09,626 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:09,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:09,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:09,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,630 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:09,630 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:09,631 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:56:09,631 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:09,631 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,632 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,942 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:09,942 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:09,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:09,943 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:09,943 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:09,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:09,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,943 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,944 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:56:09,944 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:09,944 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:56:09,944 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:09,944 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:56:09,945 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:09,945 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:09,945 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:09,945 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. started... 2023-02-08 00:56:09,945 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2caf1b6dbcce2bc4cc85ec18a74d129f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:10,375 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120503621c04f4c546e294f8410dad225f94 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120503621c04f4c546e294f8410dad225f94 2023-02-08 00:56:10,784 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/b44eb8f626ef4393a9443f0967fcaf88 2023-02-08 00:56:10,793 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/b44eb8f626ef4393a9443f0967fcaf88 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/b44eb8f626ef4393a9443f0967fcaf88 2023-02-08 00:56:10,802 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/b44eb8f626ef4393a9443f0967fcaf88, entries=1, sequenceid=17, filesize=4.9 K 2023-02-08 00:56:10,804 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2caf1b6dbcce2bc4cc85ec18a74d129f in 859ms, sequenceid=17, compaction requested=true 2023-02-08 00:56:10,804 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:10,804 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:10,804 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:10,804 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:10,804 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:10,804 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:56:10,804 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:56:11,006 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,006 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:11,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:11,007 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,008 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:11,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:11,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:11,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:56:11,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@67c197f[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:11,013 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:11,013 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,069 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,070 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:11,070 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:56:11,070 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:11,070 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,070 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:11,172 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,172 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:56:11,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:11,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:11,173 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:11,173 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:56:11,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:11,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:11,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:11,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:11,182 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:11,182 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:56:11,182 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:11,182 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:11,182 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,182 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:11,448 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,448 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:11,448 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,448 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:11,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,450 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:11,450 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:11,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:11,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,454 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:11,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,525 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,525 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:11,525 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:11,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:11,525 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,525 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,525 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,525 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,525 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:56:11,526 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:11,526 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:11,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:11,525 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:11,525 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:11,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:11,525 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:11,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:11,626 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:11,626 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:11,626 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:11,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:11,637 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:11,637 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:11,638 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:11,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:11,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,641 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:11,641 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:11,641 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:56:11,641 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:11,642 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,642 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,890 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:11,890 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:11,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:11,891 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:11,891 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:11,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,893 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:11,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,894 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,894 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:56:11,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:11,895 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:56:11,895 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:11,896 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:56:11,896 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:11,897 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:11,897 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:11,897 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. started... 2023-02-08 00:56:11,897 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2caf1b6dbcce2bc4cc85ec18a74d129f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:12,320 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122887d2aa0313af476daca3c7715579cdaa to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122887d2aa0313af476daca3c7715579cdaa 2023-02-08 00:56:12,730 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/0570b7e5372b4bbc9aa0ac7cb48e9f8e 2023-02-08 00:56:13,024 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/0570b7e5372b4bbc9aa0ac7cb48e9f8e as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/0570b7e5372b4bbc9aa0ac7cb48e9f8e 2023-02-08 00:56:13,034 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/0570b7e5372b4bbc9aa0ac7cb48e9f8e, entries=1, sequenceid=21, filesize=4.9 K 2023-02-08 00:56:13,036 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2caf1b6dbcce2bc4cc85ec18a74d129f in 1139ms, sequenceid=21, compaction requested=true 2023-02-08 00:56:13,036 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:13,036 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:13,036 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:13,036 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:13,036 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,036 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:56:13,036 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:56:13,068 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,068 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:13,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:13,069 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,069 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:13,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:13,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:13,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:56:13,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@301b2a62[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:13,074 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:13,074 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,089 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,090 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:13,090 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:56:13,090 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:13,090 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,090 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:13,100 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:56:13,100 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:13,100 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,100 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:56:13,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:13,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:13,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:13,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:13,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:13,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:13,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:13,104 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:56:13,104 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:13,104 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:13,104 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,105 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:13,454 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,454 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:13,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,454 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:13,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:13,455 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:13,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:13,455 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:13,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:13,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,456 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:13,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,726 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:13,726 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:13,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:13,727 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:13,727 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:13,727 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:56:13,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:13,727 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:13,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:13,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:13,730 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,731 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:13,731 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,731 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:13,731 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:13,731 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,731 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,831 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:13,832 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:13,832 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:13,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:13,844 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:13,845 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:13,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:13,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:13,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,849 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:13,849 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:13,850 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:56:13,850 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:13,850 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:13,850 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:14,111 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:14,111 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:14,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:14,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:14,113 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:14,113 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:14,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:14,115 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:14,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:14,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:14,116 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:14,117 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:56:14,117 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:14,117 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:56:14,118 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:14,119 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:56:14,119 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:14,119 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:14,119 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:14,120 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. started... 2023-02-08 00:56:14,120 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2caf1b6dbcce2bc4cc85ec18a74d129f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:14,677 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231ebfd9baf23fa49328e1959894a6ef354 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231ebfd9baf23fa49328e1959894a6ef354 2023-02-08 00:56:15,084 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/2cd1ce99a3d648429367df09347011f5 2023-02-08 00:56:15,097 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/2cd1ce99a3d648429367df09347011f5 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/2cd1ce99a3d648429367df09347011f5 2023-02-08 00:56:15,104 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/2cd1ce99a3d648429367df09347011f5, entries=1, sequenceid=25, filesize=4.9 K 2023-02-08 00:56:15,105 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2caf1b6dbcce2bc4cc85ec18a74d129f in 985ms, sequenceid=25, compaction requested=true 2023-02-08 00:56:15,105 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:15,105 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:15,105 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:15,105 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:15,105 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,105 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:56:15,105 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:56:15,416 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,416 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:15,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:15,416 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,416 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:15,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:15,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:15,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:15,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:56:15,419 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3309c02[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:15,419 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:15,419 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,431 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,431 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:15,431 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,431 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:15,431 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:56:15,431 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:15,441 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:56:15,441 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,441 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:15,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:15,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:15,441 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:56:15,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:15,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:15,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:15,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:15,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:15,445 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:56:15,445 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:15,445 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:15,445 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,445 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:15,707 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,707 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:15,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:15,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,707 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:15,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:15,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:15,709 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:15,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:15,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,713 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:15,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,816 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,816 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:15,816 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,816 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:15,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:15,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:15,816 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:15,817 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:15,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:15,819 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:15,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:56:15,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:15,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:15,819 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,820 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:15,820 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,820 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:15,821 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,921 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:15,921 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:15,921 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:15,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:15,934 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:15,934 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:15,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:15,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:15,938 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,938 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:15,938 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:15,938 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:56:15,938 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:15,939 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:15,939 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:16,242 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:16,242 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:16,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:16,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:16,243 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:16,244 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:16,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:16,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:16,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:16,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:16,247 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:16,248 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:56:16,248 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:16,248 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:56:16,248 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:16,249 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:56:16,249 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:16,249 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:16,249 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:16,249 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. started... 2023-02-08 00:56:16,250 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2caf1b6dbcce2bc4cc85ec18a74d129f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:16,677 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010180dc3734feb24679aa7a8a50837b25cf to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010180dc3734feb24679aa7a8a50837b25cf 2023-02-08 00:56:17,085 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/df78ef4c101340649a48c43849ccfb06 2023-02-08 00:56:17,097 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/df78ef4c101340649a48c43849ccfb06 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/df78ef4c101340649a48c43849ccfb06 2023-02-08 00:56:17,103 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/df78ef4c101340649a48c43849ccfb06, entries=1, sequenceid=29, filesize=4.9 K 2023-02-08 00:56:17,104 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2caf1b6dbcce2bc4cc85ec18a74d129f in 854ms, sequenceid=29, compaction requested=true 2023-02-08 00:56:17,104 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:17,104 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:17,104 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:17,104 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:17,104 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,104 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:56:17,104 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:56:17,241 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,241 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:17,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:17,242 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,242 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:17,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:17,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:17,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:17,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:56:17,248 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@59eb80ff[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:17,248 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:17,248 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,308 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,309 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:17,309 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,310 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:17,309 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:56:17,310 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:17,331 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:56:17,331 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:17,331 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:56:17,331 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:17,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:17,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:17,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:17,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:17,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:17,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:17,337 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:56:17,337 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:17,337 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:17,337 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,337 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:17,352 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,352 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:17,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:17,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,353 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:17,353 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:17,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:17,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:17,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:17,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,355 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:17,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,687 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:17,687 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:17,687 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:17,687 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:17,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:56:17,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:17,689 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:17,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:17,687 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,689 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,689 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:17,689 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:17,689 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:17,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:17,690 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:17,690 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,690 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,790 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:17,790 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:17,790 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:17,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:17,801 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:17,801 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:17,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:17,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:17,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,805 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:17,806 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:17,806 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:56:17,806 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:17,807 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:17,807 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:18,210 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:18,210 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:18,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:18,212 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:18,212 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:18,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:18,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:18,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:18,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:18,214 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:18,215 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:56:18,215 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:18,215 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:56:18,216 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:18,217 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:56:18,217 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:18,217 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:18,217 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:18,217 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. started... 2023-02-08 00:56:18,218 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2caf1b6dbcce2bc4cc85ec18a74d129f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:18,905 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103bca6653970744987aa5fb6107373c90e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103bca6653970744987aa5fb6107373c90e 2023-02-08 00:56:19,315 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/307981da2d0d48768035fcdd92bfdef1 2023-02-08 00:56:19,330 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/307981da2d0d48768035fcdd92bfdef1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/307981da2d0d48768035fcdd92bfdef1 2023-02-08 00:56:19,338 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/307981da2d0d48768035fcdd92bfdef1, entries=1, sequenceid=33, filesize=4.9 K 2023-02-08 00:56:19,339 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2caf1b6dbcce2bc4cc85ec18a74d129f in 1121ms, sequenceid=33, compaction requested=true 2023-02-08 00:56:19,339 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:19,339 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:19,339 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:19,339 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:19,339 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,339 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:56:19,339 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:56:19,599 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,599 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:19,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:19,601 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,601 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:19,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:19,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:19,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:19,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:56:19,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f3acd5c[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:19,605 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:19,606 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,666 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,667 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,667 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:19,667 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:19,667 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:56:19,667 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:19,710 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:56:19,710 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:19,710 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:56:19,710 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:19,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:19,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:19,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:19,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:19,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:19,716 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:19,717 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:56:19,717 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:19,717 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:19,717 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,717 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:19,757 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,757 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,757 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:19,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:19,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:19,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:19,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:19,759 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:19,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:19,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,762 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:19,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,778 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,778 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:19,778 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:19,778 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:56:19,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:19,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:19,778 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:19,778 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:19,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:19,778 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,779 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:19,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:19,779 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:19,779 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:19,779 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:19,779 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,779 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,779 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,879 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:19,880 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:19,880 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:19,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:19,891 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:19,891 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:19,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:19,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:19,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,896 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:19,896 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:19,897 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:56:19,897 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:19,898 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:19,898 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:20,184 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:20,184 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:20,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:20,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:20,184 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:20,184 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:20,185 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:20,185 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:20,186 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:56:20,186 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:20,186 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:56:20,186 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:20,186 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:56:20,186 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:20,187 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:20,187 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:20,187 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. started... 2023-02-08 00:56:20,187 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2caf1b6dbcce2bc4cc85ec18a74d129f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:20,609 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907d03f6836f2674541bec863fe1822c22f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907d03f6836f2674541bec863fe1822c22f 2023-02-08 00:56:21,016 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/11141742f98146ff9d4c8f2d3e0bc710 2023-02-08 00:56:21,031 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/11141742f98146ff9d4c8f2d3e0bc710 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/11141742f98146ff9d4c8f2d3e0bc710 2023-02-08 00:56:21,038 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/11141742f98146ff9d4c8f2d3e0bc710, entries=1, sequenceid=37, filesize=4.9 K 2023-02-08 00:56:21,039 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2caf1b6dbcce2bc4cc85ec18a74d129f in 852ms, sequenceid=37, compaction requested=true 2023-02-08 00:56:21,039 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:21,039 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:21,039 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:21,039 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:21,040 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,040 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:56:21,040 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:56:21,346 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,346 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:21,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:21,346 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,346 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:21,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:21,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:21,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:21,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:56:21,349 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@569ba8e3[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:21,349 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:21,349 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,363 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,363 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:21,363 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:56:21,363 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:21,363 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,363 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:21,373 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:56:21,373 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,373 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:21,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:21,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:21,374 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:56:21,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:21,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:21,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:21,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:21,378 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:21,378 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:56:21,378 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:21,378 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:21,378 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,378 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:21,394 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,394 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:21,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:21,394 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:21,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:21,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:21,395 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:21,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:21,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,397 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:21,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,704 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,704 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,704 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,704 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:21,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:56:21,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:21,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:21,704 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:21,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:21,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:21,704 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,704 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:21,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:21,705 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:21,706 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:21,706 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,707 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:21,707 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,807 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:21,807 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:21,807 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:21,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:21,814 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:21,814 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:21,815 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:21,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:21,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,817 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:21,818 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:21,818 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:56:21,818 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:21,819 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,819 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,952 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:21,952 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:21,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:21,954 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:21,954 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:21,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,955 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:21,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,957 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,957 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:56:21,957 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:21,958 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:56:21,958 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:21,959 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:56:21,959 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:21,959 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:21,959 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:21,960 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. started... 2023-02-08 00:56:21,960 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 2caf1b6dbcce2bc4cc85ec18a74d129f 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:21,976 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112062378ee2e754420b8294245f712d3687 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112062378ee2e754420b8294245f712d3687 2023-02-08 00:56:22,386 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/573c479f4a034d49a392c31d7fb73e33 2023-02-08 00:56:22,399 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/573c479f4a034d49a392c31d7fb73e33 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/573c479f4a034d49a392c31d7fb73e33 2023-02-08 00:56:22,408 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/573c479f4a034d49a392c31d7fb73e33, entries=1, sequenceid=41, filesize=4.9 K 2023-02-08 00:56:22,409 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 2caf1b6dbcce2bc4cc85ec18a74d129f in 449ms, sequenceid=41, compaction requested=true 2023-02-08 00:56:22,409 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:22,409 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:22,409 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:22,409 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:22,409 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,410 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:56:22,410 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:56:22,546 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,546 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:22,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:22,548 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,548 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:22,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:22,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:22,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:22,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:56:22,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@51ccfebe[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:22,554 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:22,555 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,613 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,613 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,614 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:22,614 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:56:22,614 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:22,614 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,614 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:22,641 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:56:22,641 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,641 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:22,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:22,641 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:56:22,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:22,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:22,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:22,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:22,649 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:56:22,649 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:22,649 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:22,649 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,649 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:22,923 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,923 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:22,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:22,923 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:22,923 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:22,926 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:22,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:22,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,928 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:22,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,956 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:22,956 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:22,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:22,957 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:22,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-02-08 00:56:22,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:22,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:56:22,957 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,957 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:22,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:22,957 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:22,958 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:22,957 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:22,958 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:22,958 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,958 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:22,958 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:23,058 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:23,059 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:23,059 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:23,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:23,063 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-02-08 00:56:23,065 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 00:56:23,066 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 00:56:23,068 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:56:23,068 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818383068 2023-02-08 00:56:23,071 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 00:56:23,073 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-08 00:56:23,073 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:56:23,073 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x3b5e4bbb to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:56:23,397 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@702a075e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:56:23,398 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:56:24,248 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010302bbc66246444179bd8f987079a83484 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010302bbc66246444179bd8f987079a83484 2023-02-08 00:56:24,250 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:56:24,263 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:56:24,264 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:37564, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:56:24,270 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:24,270 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:24,270 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:56:24,271 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:46726, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:56:24,281 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/646fdb9f5d3649c48e7c2988f0b3a7c0 first=Optional[r5] last=Optional[r6] 2023-02-08 00:56:24,282 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/646fdb9f5d3649c48e7c2988f0b3a7c0}] 2023-02-08 00:56:24,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/646fdb9f5d3649c48e7c2988f0b3a7c0 for inclusion in 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 2023-02-08 00:56:24,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-08 00:56:24,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:56:24,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:24,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/646fdb9f5d3649c48e7c2988f0b3a7c0 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__krtcsl0ko4q47mqorovpjb6e6srgvoeeriihn3bp6sf2s28jf5q0uk0pf6qhve1t/family1/646fdb9f5d3649c48e7c2988f0b3a7c0 2023-02-08 00:56:24,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__krtcsl0ko4q47mqorovpjb6e6srgvoeeriihn3bp6sf2s28jf5q0uk0pf6qhve1t/family1/646fdb9f5d3649c48e7c2988f0b3a7c0 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/688eb54ac0c9441c89398c7939c58b3f_SeqId_44_ 2023-02-08 00:56:24,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__krtcsl0ko4q47mqorovpjb6e6srgvoeeriihn3bp6sf2s28jf5q0uk0pf6qhve1t/family1/646fdb9f5d3649c48e7c2988f0b3a7c0 into 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/688eb54ac0c9441c89398c7939c58b3f_SeqId_44_ - updating store file list. 2023-02-08 00:56:24,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/688eb54ac0c9441c89398c7939c58b3f_SeqId_44_ into 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 2023-02-08 00:56:24,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__krtcsl0ko4q47mqorovpjb6e6srgvoeeriihn3bp6sf2s28jf5q0uk0pf6qhve1t/family1/646fdb9f5d3649c48e7c2988f0b3a7c0 into 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/688eb54ac0c9441c89398c7939c58b3f_SeqId_44_) 2023-02-08 00:56:24,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__krtcsl0ko4q47mqorovpjb6e6srgvoeeriihn3bp6sf2s28jf5q0uk0pf6qhve1t/family1/646fdb9f5d3649c48e7c2988f0b3a7c0 2023-02-08 00:56:24,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-08 00:56:24,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-08 00:56:24,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 is initiating minor compaction 2023-02-08 00:56:24,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@58736a12; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:56:24,307 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 in testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:24,308 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/3542017e5e634fdf9cc22a2a7adf7023, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/37b8a7c07cc24c6d92015f07e65b6f32, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/b44eb8f626ef4393a9443f0967fcaf88, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/0570b7e5372b4bbc9aa0ac7cb48e9f8e, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/2cd1ce99a3d648429367df09347011f5, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/df78ef4c101340649a48c43849ccfb06, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/307981da2d0d48768035fcdd92bfdef1, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/11141742f98146ff9d4c8f2d3e0bc710, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/573c479f4a034d49a392c31d7fb73e33, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/688eb54ac0c9441c89398c7939c58b3f_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp, totalSize=49.7 K 2023-02-08 00:56:24,308 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 3542017e5e634fdf9cc22a2a7adf7023, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 00:56:24,308 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 37b8a7c07cc24c6d92015f07e65b6f32, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 00:56:24,308 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting b44eb8f626ef4393a9443f0967fcaf88, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-08 00:56:24,308 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 0570b7e5372b4bbc9aa0ac7cb48e9f8e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-08 00:56:24,308 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 2cd1ce99a3d648429367df09347011f5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-08 00:56:24,308 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting df78ef4c101340649a48c43849ccfb06, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-08 00:56:24,308 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 307981da2d0d48768035fcdd92bfdef1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-08 00:56:24,309 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 11141742f98146ff9d4c8f2d3e0bc710, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-08 00:56:24,309 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 573c479f4a034d49a392c31d7fb73e33, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-08 00:56:24,309 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 688eb54ac0c9441c89398c7939c58b3f_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-08 00:56:24,310 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:56:24,311 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:56:24,313 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010180dc3734feb24679aa7a8a50837b25cf to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2016010180dc3734feb24679aa7a8a50837b25cf 2023-02-08 00:56:24,314 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103bca6653970744987aa5fb6107373c90e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103bca6653970744987aa5fb6107373c90e 2023-02-08 00:56:24,315 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-08 00:56:24,315 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-08 00:56:24,315 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:56:24,315 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:56:24,382 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2caf1b6dbcce2bc4cc85ec18a74d129f#family1#compaction#22 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:56:25,345 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231267743aa33dc4db5971288094b668314 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231267743aa33dc4db5971288094b668314 2023-02-08 00:56:25,346 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/16d55d0452664e779a65e930dbdce7e9 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/16d55d0452664e779a65e930dbdce7e9 2023-02-08 00:56:25,347 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:56:25,353 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 of 2caf1b6dbcce2bc4cc85ec18a74d129f into 16d55d0452664e779a65e930dbdce7e9(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:56:25,353 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:25,354 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1675817784307; duration=1sec 2023-02-08 00:56:25,354 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:56:25,369 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:25,370 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:25,380 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c93b11f9318d4d14beca60b700bcb941 first=Optional[r1] last=Optional[r4] 2023-02-08 00:56:25,380 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c93b11f9318d4d14beca60b700bcb941}] 2023-02-08 00:56:25,383 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c93b11f9318d4d14beca60b700bcb941 for inclusion in 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 2023-02-08 00:56:25,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-08 00:56:25,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:56:25,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:25,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/c93b11f9318d4d14beca60b700bcb941 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g1bs96bqcdiadh4hi0bvb33l0o4heocbr10glu5m9kpd2lkn1tmg68cqnucbkjdd/family1/c93b11f9318d4d14beca60b700bcb941 2023-02-08 00:56:25,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g1bs96bqcdiadh4hi0bvb33l0o4heocbr10glu5m9kpd2lkn1tmg68cqnucbkjdd/family1/c93b11f9318d4d14beca60b700bcb941 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/3dad95bf08784c4ba5ba9eb9a82f1d80_SeqId_47_ 2023-02-08 00:56:25,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g1bs96bqcdiadh4hi0bvb33l0o4heocbr10glu5m9kpd2lkn1tmg68cqnucbkjdd/family1/c93b11f9318d4d14beca60b700bcb941 into 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/3dad95bf08784c4ba5ba9eb9a82f1d80_SeqId_47_ - updating store file list. 2023-02-08 00:56:25,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/3dad95bf08784c4ba5ba9eb9a82f1d80_SeqId_47_ into 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 2023-02-08 00:56:25,398 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g1bs96bqcdiadh4hi0bvb33l0o4heocbr10glu5m9kpd2lkn1tmg68cqnucbkjdd/family1/c93b11f9318d4d14beca60b700bcb941 into 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/3dad95bf08784c4ba5ba9eb9a82f1d80_SeqId_47_) 2023-02-08 00:56:25,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__g1bs96bqcdiadh4hi0bvb33l0o4heocbr10glu5m9kpd2lkn1tmg68cqnucbkjdd/family1/c93b11f9318d4d14beca60b700bcb941 2023-02-08 00:56:25,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 00:56:25,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 00:56:25,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 is initiating minor compaction (all files) 2023-02-08 00:56:25,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@39ef446a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:56:25,400 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 in testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 00:56:25,401 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/5f9da23ff90e47d7b94ffb231fae6e45, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/16d55d0452664e779a65e930dbdce7e9, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/3dad95bf08784c4ba5ba9eb9a82f1d80_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp, totalSize=178.1 K 2023-02-08 00:56:25,401 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 5f9da23ff90e47d7b94ffb231fae6e45, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878836759 2023-02-08 00:56:25,402 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 16d55d0452664e779a65e930dbdce7e9, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621236759 2023-02-08 00:56:25,402 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 3dad95bf08784c4ba5ba9eb9a82f1d80_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965236759 2023-02-08 00:56:25,402 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:56:25,403 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:56:25,405 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201b8824a3c3adc48388fc7ff456fa52722 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201b8824a3c3adc48388fc7ff456fa52722 2023-02-08 00:56:25,406 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120503621c04f4c546e294f8410dad225f94 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015120503621c04f4c546e294f8410dad225f94 2023-02-08 00:56:25,407 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122887d2aa0313af476daca3c7715579cdaa to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015122887d2aa0313af476daca3c7715579cdaa 2023-02-08 00:56:25,408 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231ebfd9baf23fa49328e1959894a6ef354 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231ebfd9baf23fa49328e1959894a6ef354 2023-02-08 00:56:25,408 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-08 00:56:25,408 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-08 00:56:25,409 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:56:25,409 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:56:25,431 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:56:25,432 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x423255da to 127.0.0.1:49726 2023-02-08 00:56:25,434 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:56:25,435 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:56:25,435 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13bc3a43 to 127.0.0.1:49726 2023-02-08 00:56:25,435 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:56:25,438 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/3542017e5e634fdf9cc22a2a7adf7023, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/37b8a7c07cc24c6d92015f07e65b6f32, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/b44eb8f626ef4393a9443f0967fcaf88, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/0570b7e5372b4bbc9aa0ac7cb48e9f8e, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/2cd1ce99a3d648429367df09347011f5, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/df78ef4c101340649a48c43849ccfb06, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/307981da2d0d48768035fcdd92bfdef1, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/11141742f98146ff9d4c8f2d3e0bc710, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/573c479f4a034d49a392c31d7fb73e33, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/688eb54ac0c9441c89398c7939c58b3f_SeqId_44_] to archive 2023-02-08 00:56:25,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:56:25,442 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/3542017e5e634fdf9cc22a2a7adf7023 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/3542017e5e634fdf9cc22a2a7adf7023 2023-02-08 00:56:25,443 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/37b8a7c07cc24c6d92015f07e65b6f32 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/37b8a7c07cc24c6d92015f07e65b6f32 2023-02-08 00:56:25,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/b44eb8f626ef4393a9443f0967fcaf88 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/b44eb8f626ef4393a9443f0967fcaf88 2023-02-08 00:56:25,447 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/0570b7e5372b4bbc9aa0ac7cb48e9f8e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/0570b7e5372b4bbc9aa0ac7cb48e9f8e 2023-02-08 00:56:25,448 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/2cd1ce99a3d648429367df09347011f5 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/2cd1ce99a3d648429367df09347011f5 2023-02-08 00:56:25,449 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2caf1b6dbcce2bc4cc85ec18a74d129f#family1#compaction#23 average throughput is 7.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:56:25,451 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/df78ef4c101340649a48c43849ccfb06 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/df78ef4c101340649a48c43849ccfb06 2023-02-08 00:56:25,452 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/307981da2d0d48768035fcdd92bfdef1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/307981da2d0d48768035fcdd92bfdef1 2023-02-08 00:56:25,455 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/11141742f98146ff9d4c8f2d3e0bc710 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/11141742f98146ff9d4c8f2d3e0bc710 2023-02-08 00:56:25,457 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/573c479f4a034d49a392c31d7fb73e33 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/573c479f4a034d49a392c31d7fb73e33 2023-02-08 00:56:25,458 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/688eb54ac0c9441c89398c7939c58b3f_SeqId_44_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/688eb54ac0c9441c89398c7939c58b3f_SeqId_44_ 2023-02-08 00:56:25,481 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/.tmp/family1/cd0face21197438bb4313992dc5ecf47 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/cd0face21197438bb4313992dc5ecf47 2023-02-08 00:56:25,487 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 of 2caf1b6dbcce2bc4cc85ec18a74d129f into cd0face21197438bb4313992dc5ecf47(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:56:25,488 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:25,488 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1675817785400; duration=0sec 2023-02-08 00:56:25,488 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:56:25,518 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/5f9da23ff90e47d7b94ffb231fae6e45, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/16d55d0452664e779a65e930dbdce7e9, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/3dad95bf08784c4ba5ba9eb9a82f1d80_SeqId_47_] to archive 2023-02-08 00:56:25,519 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:56:25,521 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/5f9da23ff90e47d7b94ffb231fae6e45 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/5f9da23ff90e47d7b94ffb231fae6e45 2023-02-08 00:56:25,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/16d55d0452664e779a65e930dbdce7e9 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/16d55d0452664e779a65e930dbdce7e9 2023-02-08 00:56:25,524 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/3dad95bf08784c4ba5ba9eb9a82f1d80_SeqId_47_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/3dad95bf08784c4ba5ba9eb9a82f1d80_SeqId_47_ 2023-02-08 00:56:25,897 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b48a84c3018b4969b55ab1d488432e9e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b48a84c3018b4969b55ab1d488432e9e 2023-02-08 00:56:25,899 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:56:25,916 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:25,916 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:25,926 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6d80f80485264a2d9d4fd17903a22e46 first=Optional[r00] last=Optional[r8] 2023-02-08 00:56:25,926 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6d80f80485264a2d9d4fd17903a22e46}] 2023-02-08 00:56:25,929 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6d80f80485264a2d9d4fd17903a22e46 for inclusion in 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 2023-02-08 00:56:25,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-08 00:56:25,932 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:56:25,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: 2023-02-08 00:56:25,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/6d80f80485264a2d9d4fd17903a22e46 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bgncbevi8br0s3b405ais2jq92dgq2cu1rplrq1407srmgos7k2qi9uon3jm19rk/family1/6d80f80485264a2d9d4fd17903a22e46 2023-02-08 00:56:25,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bgncbevi8br0s3b405ais2jq92dgq2cu1rplrq1407srmgos7k2qi9uon3jm19rk/family1/6d80f80485264a2d9d4fd17903a22e46 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/dac04fb4785d4d4390c2ca08a00500c1_SeqId_50_ 2023-02-08 00:56:25,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bgncbevi8br0s3b405ais2jq92dgq2cu1rplrq1407srmgos7k2qi9uon3jm19rk/family1/6d80f80485264a2d9d4fd17903a22e46 into 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/dac04fb4785d4d4390c2ca08a00500c1_SeqId_50_ - updating store file list. 2023-02-08 00:56:25,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/dac04fb4785d4d4390c2ca08a00500c1_SeqId_50_ into 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 2023-02-08 00:56:25,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bgncbevi8br0s3b405ais2jq92dgq2cu1rplrq1407srmgos7k2qi9uon3jm19rk/family1/6d80f80485264a2d9d4fd17903a22e46 into 2caf1b6dbcce2bc4cc85ec18a74d129f/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/family1/dac04fb4785d4d4390c2ca08a00500c1_SeqId_50_) 2023-02-08 00:56:25,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithMonthlyPolicy__bgncbevi8br0s3b405ais2jq92dgq2cu1rplrq1407srmgos7k2qi9uon3jm19rk/family1/6d80f80485264a2d9d4fd17903a22e46 2023-02-08 00:56:25,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:56:25,946 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:56:25,948 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112062378ee2e754420b8294245f712d3687 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112062378ee2e754420b8294245f712d3687 2023-02-08 00:56:25,949 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511286546f5f094e347f39462498955490eb4 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511286546f5f094e347f39462498955490eb4 2023-02-08 00:56:25,950 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511300f4c583bfce041fb8bdaf65fa2d8b639 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511300f4c583bfce041fb8bdaf65fa2d8b639 2023-02-08 00:56:25,950 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-08 00:56:25,951 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-08 00:56:25,951 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:56:25,951 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:56:25,951 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:56:25,951 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:56:25,951 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:56:25,952 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 00:56:25,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.8880 sec 2023-02-08 00:56:26,063 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=239 (was 241), OpenFileDescriptor=582 (was 576) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=308 (was 341), ProcessCount=175 (was 175), AvailableMemoryMB=3510 (was 3647) 2023-02-08 00:56:26,074 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=239, OpenFileDescriptor=582, MaxFileDescriptor=60000, SystemLoadAverage=308, ProcessCount=175, AvailableMemoryMB=3510 2023-02-08 00:56:26,075 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:26,075 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:26,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-08 00:56:26,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:26,079 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 00:56:26,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-02-08 00:56:26,080 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:26,080 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:26,080 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 00:56:26,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-08 00:56:26,082 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1 2023-02-08 00:56:26,082 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1 empty. 2023-02-08 00:56:26,083 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1 2023-02-08 00:56:26,083 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-02-08 00:56:26,181 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:26,181 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:26,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-08 00:56:26,383 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:26,383 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:26,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-08 00:56:26,493 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-08 00:56:26,495 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 308c8dc09348dd627b816fb996c571a1, NAME => 'testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:56:26,685 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:26,685 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:26,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-08 00:56:26,905 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:56:26,906 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 308c8dc09348dd627b816fb996c571a1, disabling compactions & flushes 2023-02-08 00:56:26,906 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:26,906 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:26,906 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. after waiting 0 ms 2023-02-08 00:56:26,906 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:26,906 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:26,906 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 308c8dc09348dd627b816fb996c571a1: Waiting for close lock at 1675817786906Disabling compacts and flushes for region at 1675817786906Disabling writes for close at 1675817786906Writing region close event to WAL at 1675817786906Closed at 1675817786906 2023-02-08 00:56:26,912 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 00:56:26,914 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675817786914"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817786914"}]},"ts":"1675817786914"} 2023-02-08 00:56:26,916 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 00:56:26,917 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 00:56:26,917 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817786917"}]},"ts":"1675817786917"} 2023-02-08 00:56:26,919 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-08 00:56:27,188 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:27,189 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:27,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-08 00:56:27,651 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=308c8dc09348dd627b816fb996c571a1, ASSIGN}] 2023-02-08 00:56:27,653 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=308c8dc09348dd627b816fb996c571a1, ASSIGN 2023-02-08 00:56:27,654 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=308c8dc09348dd627b816fb996c571a1, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:56:27,806 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=308c8dc09348dd627b816fb996c571a1, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:27,807 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675817787806"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817787806"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817787806"}]},"ts":"1675817787806"} 2023-02-08 00:56:27,812 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 308c8dc09348dd627b816fb996c571a1, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:56:27,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:27,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 308c8dc09348dd627b816fb996c571a1, NAME => 'testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:56:27,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 308c8dc09348dd627b816fb996c571a1 2023-02-08 00:56:27,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:56:27,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 308c8dc09348dd627b816fb996c571a1 2023-02-08 00:56:27,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 308c8dc09348dd627b816fb996c571a1 2023-02-08 00:56:27,976 INFO [StoreOpener-308c8dc09348dd627b816fb996c571a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 308c8dc09348dd627b816fb996c571a1 2023-02-08 00:56:27,978 DEBUG [StoreOpener-308c8dc09348dd627b816fb996c571a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1 2023-02-08 00:56:27,978 DEBUG [StoreOpener-308c8dc09348dd627b816fb996c571a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1 2023-02-08 00:56:27,979 INFO [StoreOpener-308c8dc09348dd627b816fb996c571a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 308c8dc09348dd627b816fb996c571a1 columnFamilyName family1 2023-02-08 00:56:27,981 INFO [StoreOpener-308c8dc09348dd627b816fb996c571a1-1] regionserver.HStore(310): Store=308c8dc09348dd627b816fb996c571a1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:56:27,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1 2023-02-08 00:56:27,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1 2023-02-08 00:56:27,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 308c8dc09348dd627b816fb996c571a1 2023-02-08 00:56:27,990 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:56:27,991 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 308c8dc09348dd627b816fb996c571a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63521181, jitterRate=-0.05346064269542694}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:56:27,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 308c8dc09348dd627b816fb996c571a1: Running coprocessor pre-open hook at 1675817787973Writing region info on filesystem at 1675817787973Initializing all the Stores at 1675817787975 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675817787975Cleaning up temporary data from old regions at 1675817787984 (+9 ms)Cleaning up detritus from prior splits at 1675817787984Running coprocessor post-open hooks at 1675817787991 (+7 ms)Region opened successfully at 1675817787991 2023-02-08 00:56:27,992 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1., pid=25, masterSystemTime=1675817787965 2023-02-08 00:56:27,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:27,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:27,995 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=308c8dc09348dd627b816fb996c571a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:27,996 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675817787995"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817787995"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817787995"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817787995"}]},"ts":"1675817787995"} 2023-02-08 00:56:28,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=24 2023-02-08 00:56:28,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 308c8dc09348dd627b816fb996c571a1, server=jenkins-hbase12.apache.org,36907,1675817727419 in 187 msec 2023-02-08 00:56:28,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=23 2023-02-08 00:56:28,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=308c8dc09348dd627b816fb996c571a1, ASSIGN in 349 msec 2023-02-08 00:56:28,003 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 00:56:28,003 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817788003"}]},"ts":"1675817788003"} 2023-02-08 00:56:28,005 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-08 00:56:28,192 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:28,193 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:28,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-08 00:56:28,323 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 00:56:28,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 2.2470 sec 2023-02-08 00:56:30,196 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:30,196 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:30,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=23 2023-02-08 00:56:30,199 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-02-08 00:56:30,232 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:30,232 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:30,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:30,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:30,234 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:30,234 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:30,235 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:56:30,235 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:30,235 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:30,235 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:30,561 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:30,561 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:30,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:30,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:30,562 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:30,563 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:30,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:30,564 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:30,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:30,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:30,566 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:30,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:30,567 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:56:30,567 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:30,567 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:56:30,568 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:30,568 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:30,568 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:30,568 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. started... 2023-02-08 00:56:30,569 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 308c8dc09348dd627b816fb996c571a1 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-08 00:56:30,992 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511309d56c3d6b9944ec48209594a331c98a3 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511309d56c3d6b9944ec48209594a331c98a3 2023-02-08 00:56:31,398 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/e3a8f0cf86d54d5e9195b96def077dd2 2023-02-08 00:56:31,410 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/e3a8f0cf86d54d5e9195b96def077dd2 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/e3a8f0cf86d54d5e9195b96def077dd2 2023-02-08 00:56:31,418 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/e3a8f0cf86d54d5e9195b96def077dd2, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-08 00:56:31,419 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 308c8dc09348dd627b816fb996c571a1 in 850ms, sequenceid=5, compaction requested=false 2023-02-08 00:56:31,419 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:31,419 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 308c8dc09348dd627b816fb996c571a1: 2023-02-08 00:56:31,419 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:31,420 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:31,420 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:31,420 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:31,420 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:56:31,420 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:56:31,741 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:31,741 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:31,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:31,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:31,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:31,762 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:31,762 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:31,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:31,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:31,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:31,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:31,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:31,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:56:31,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@54a57000[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:31,764 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:31,764 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:31,777 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:31,777 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:31,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:31,777 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:31,777 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:56:31,777 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:31,777 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:31,777 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:31,787 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:31,787 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:56:31,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:31,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:31,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:31,787 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:31,788 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:56:31,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:31,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:31,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:31,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:31,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:31,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:31,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:31,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:31,791 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:31,791 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:56:31,791 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:31,791 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:31,791 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:31,791 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:31,909 DEBUG [regionserver/jenkins-hbase12:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-08 00:56:32,124 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,124 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,125 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:32,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:32,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:32,126 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:32,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:32,127 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:32,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:32,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:32,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,129 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:32,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:32,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:32,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:32,215 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:32,215 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,215 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,216 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:32,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:32,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:32,215 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:32,216 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,216 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,217 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,217 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:32,217 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:32,216 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:32,217 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:56:32,216 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:32,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:32,216 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:32,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:32,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:32,317 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:32,318 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:32,318 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:32,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:32,327 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:32,327 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:32,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:32,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:32,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,332 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:32,333 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:32,333 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:56:32,334 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:32,335 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,335 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,668 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:32,668 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:32,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:32,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:32,710 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:32,710 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:32,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,711 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:32,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,712 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,712 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:56:32,712 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:32,712 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:56:32,712 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:32,713 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:56:32,713 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:32,713 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:32,714 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:32,714 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. started... 2023-02-08 00:56:32,714 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 308c8dc09348dd627b816fb996c571a1 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-08 00:56:33,134 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511281aed5949e78849a38b026484fc57bdd5 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511281aed5949e78849a38b026484fc57bdd5 2023-02-08 00:56:33,504 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:56:33,541 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/d6feeca6eec74bbf99ff9adcc613b0ef 2023-02-08 00:56:33,548 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/d6feeca6eec74bbf99ff9adcc613b0ef as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/d6feeca6eec74bbf99ff9adcc613b0ef 2023-02-08 00:56:33,555 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/d6feeca6eec74bbf99ff9adcc613b0ef, entries=1, sequenceid=9, filesize=5.0 K 2023-02-08 00:56:33,557 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 308c8dc09348dd627b816fb996c571a1 in 843ms, sequenceid=9, compaction requested=false 2023-02-08 00:56:33,557 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 308c8dc09348dd627b816fb996c571a1: 2023-02-08 00:56:33,557 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:33,557 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:33,557 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:33,557 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:33,557 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:56:33,557 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:56:33,851 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:33,851 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:33,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:33,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:33,853 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,853 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:33,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:33,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:33,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:33,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:33,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:56:33,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3d9c07e5[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:33,858 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:33,858 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,871 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,872 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:33,872 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:33,872 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:33,872 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:56:33,872 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:33,882 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:56:33,882 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:33,882 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:33,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:33,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:33,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:33,882 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:56:33,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:33,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:33,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:33,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:33,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:33,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:33,886 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:33,886 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:56:33,886 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:33,886 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:33,886 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,886 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:33,903 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,903 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,903 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:33,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:33,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:33,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:33,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:33,904 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:33,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:33,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:33,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,905 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:33,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:33,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:33,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:33,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:34,237 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:34,237 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:34,237 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:34,237 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:34,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:56:34,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:34,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:34,237 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:34,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:34,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:34,237 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:34,240 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:34,240 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:34,239 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:34,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:34,241 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:34,241 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:34,241 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:34,340 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:34,341 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:34,341 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:34,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:34,347 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:34,347 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:34,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:34,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:34,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:34,351 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:34,351 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:34,352 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:56:34,352 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:34,352 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:34,352 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:34,625 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:34,625 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:34,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:34,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:34,627 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:34,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:34,627 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:34,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:34,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:34,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:34,629 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:34,630 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:56:34,630 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:34,630 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:56:34,631 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:34,632 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:56:34,632 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:34,632 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:34,632 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:34,632 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. started... 2023-02-08 00:56:34,633 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 308c8dc09348dd627b816fb996c571a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:35,057 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512017500d06b52c14786853def4b65b08590 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512017500d06b52c14786853def4b65b08590 2023-02-08 00:56:35,464 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/c9f65e2a89d84de49b3ccb82cfdb23e0 2023-02-08 00:56:35,477 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/c9f65e2a89d84de49b3ccb82cfdb23e0 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/c9f65e2a89d84de49b3ccb82cfdb23e0 2023-02-08 00:56:35,483 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/c9f65e2a89d84de49b3ccb82cfdb23e0, entries=1, sequenceid=13, filesize=4.9 K 2023-02-08 00:56:35,484 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 308c8dc09348dd627b816fb996c571a1 in 851ms, sequenceid=13, compaction requested=true 2023-02-08 00:56:35,484 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 308c8dc09348dd627b816fb996c571a1: 2023-02-08 00:56:35,484 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:35,484 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:35,484 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:35,484 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:35,484 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:56:35,484 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:56:35,793 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:35,794 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:35,794 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:35,794 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:35,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:35,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:35,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:56:35,797 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36cb6c05[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:35,797 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:35,797 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,066 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,067 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:36,067 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:56:36,067 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:36,068 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:36,068 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:36,132 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:36,132 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:56:36,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:36,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:36,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:36,132 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:36,133 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:56:36,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:36,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:36,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:36,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:36,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:36,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:36,140 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:36,140 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:56:36,140 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:36,140 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:36,140 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,140 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:36,393 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,394 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,394 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:36,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,395 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:36,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:36,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:36,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:36,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:36,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,397 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:36,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:36,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:36,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:36,414 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:36,414 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:36,415 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:36,415 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:56:36,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:36,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:36,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:36,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:36,415 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:36,415 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,416 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:36,416 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:36,416 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:36,416 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:36,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:36,416 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,416 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,416 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,516 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:36,516 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:36,516 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:36,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:36,526 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:36,526 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:36,528 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:36,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:36,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,531 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:36,531 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:36,531 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:56:36,531 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:36,532 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,532 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,799 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:36,800 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:36,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:36,801 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:36,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,801 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:36,803 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:36,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,804 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,805 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:56:36,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:36,805 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:56:36,805 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:36,806 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:56:36,806 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:36,807 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:36,807 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:36,807 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. started... 2023-02-08 00:56:36,807 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 308c8dc09348dd627b816fb996c571a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:37,227 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205171e987cca0d4c7f83783f09f6911368 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205171e987cca0d4c7f83783f09f6911368 2023-02-08 00:56:37,636 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/d6b3645de4434e94a6061b7914935cd3 2023-02-08 00:56:37,646 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/d6b3645de4434e94a6061b7914935cd3 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/d6b3645de4434e94a6061b7914935cd3 2023-02-08 00:56:37,651 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/d6b3645de4434e94a6061b7914935cd3, entries=1, sequenceid=17, filesize=4.9 K 2023-02-08 00:56:37,652 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 308c8dc09348dd627b816fb996c571a1 in 845ms, sequenceid=17, compaction requested=true 2023-02-08 00:56:37,652 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 308c8dc09348dd627b816fb996c571a1: 2023-02-08 00:56:37,652 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:37,652 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:37,653 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:37,653 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:37,653 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:56:37,653 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:56:38,046 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,046 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:38,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:38,048 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,048 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:38,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:38,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:38,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:38,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:56:38,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@444d6c[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:38,053 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:38,053 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,111 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,112 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:38,112 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:56:38,112 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:38,112 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,112 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:38,134 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:56:38,134 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:38,135 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:56:38,134 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:38,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:38,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:38,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:38,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:38,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:38,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:38,141 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:56:38,142 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:38,142 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:38,142 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,142 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:38,162 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,162 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:38,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:38,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,162 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:38,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:38,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:38,163 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:38,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,165 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:38,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,509 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,509 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,509 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,509 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:38,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:38,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:38,509 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:38,509 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:38,509 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:38,511 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:38,510 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:56:38,510 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,511 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,511 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:38,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:38,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:38,511 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,612 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:38,612 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:38,612 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:38,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:38,619 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:38,620 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:38,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:38,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:38,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,624 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:38,624 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:38,625 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:56:38,625 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:38,626 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,626 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,945 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:38,945 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:38,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:38,945 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:38,945 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:38,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,946 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:38,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,946 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,946 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:56:38,946 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:38,947 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:56:38,947 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:38,947 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:56:38,947 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:38,947 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:38,947 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:38,947 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. started... 2023-02-08 00:56:38,948 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 308c8dc09348dd627b816fb996c571a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:39,376 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228a3d3a7fe4a0741c4a6e40bd664337f28 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228a3d3a7fe4a0741c4a6e40bd664337f28 2023-02-08 00:56:39,784 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/4e89557638b848f8937f78e4fe76ac7b 2023-02-08 00:56:39,798 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/4e89557638b848f8937f78e4fe76ac7b as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/4e89557638b848f8937f78e4fe76ac7b 2023-02-08 00:56:39,805 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/4e89557638b848f8937f78e4fe76ac7b, entries=1, sequenceid=21, filesize=4.9 K 2023-02-08 00:56:39,806 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 308c8dc09348dd627b816fb996c571a1 in 858ms, sequenceid=21, compaction requested=true 2023-02-08 00:56:39,806 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 308c8dc09348dd627b816fb996c571a1: 2023-02-08 00:56:39,806 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:39,806 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:39,806 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:39,806 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:39,806 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:56:39,806 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:56:40,155 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,155 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:40,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:40,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:40,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:40,155 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,156 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:40,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:40,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:40,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:40,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:40,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:56:40,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f1e1814[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:40,159 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:40,159 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,187 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,187 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:40,187 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:40,187 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:40,187 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:56:40,187 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:40,197 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:56:40,197 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:40,197 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:40,197 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:56:40,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:40,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:40,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:40,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:40,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:40,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:40,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:40,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:40,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:40,203 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:40,203 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:56:40,203 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:40,203 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:40,203 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,203 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:40,524 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,524 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,524 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:40,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:40,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:40,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:40,526 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:40,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:40,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:40,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,530 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:40,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:40,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:40,703 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:40,703 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:40,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:40,703 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:40,703 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:40,703 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,703 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,704 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:40,704 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,704 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,704 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,703 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:56:40,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:40,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:40,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:40,705 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:40,705 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:40,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:40,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:40,806 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:40,806 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:40,806 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:40,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:40,816 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:40,816 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:40,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:40,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:40,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,820 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:40,820 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:40,821 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:56:40,821 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:40,821 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:40,822 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:41,134 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:41,135 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:41,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:41,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:41,136 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:41,136 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:41,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:41,138 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:41,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:41,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:41,139 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:41,139 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:56:41,140 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:41,140 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:56:41,140 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:41,140 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:56:41,140 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:41,141 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:41,141 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:41,141 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. started... 2023-02-08 00:56:41,141 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 308c8dc09348dd627b816fb996c571a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:41,645 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231e7d7636a2ff341dbacb56e0a02361e52 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231e7d7636a2ff341dbacb56e0a02361e52 2023-02-08 00:56:42,053 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/1570e8b66c9049faa3654568725f2c97 2023-02-08 00:56:42,066 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/1570e8b66c9049faa3654568725f2c97 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1570e8b66c9049faa3654568725f2c97 2023-02-08 00:56:42,072 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1570e8b66c9049faa3654568725f2c97, entries=1, sequenceid=25, filesize=4.9 K 2023-02-08 00:56:42,073 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 308c8dc09348dd627b816fb996c571a1 in 932ms, sequenceid=25, compaction requested=true 2023-02-08 00:56:42,073 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 308c8dc09348dd627b816fb996c571a1: 2023-02-08 00:56:42,073 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:42,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:42,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:42,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:56:42,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:56:42,397 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,397 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:42,398 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,398 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:42,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:42,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:42,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:56:42,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22609b3d[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:42,402 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:42,402 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,449 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,449 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:42,449 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:56:42,449 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:42,449 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,450 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:42,471 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:56:42,471 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,471 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,471 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:56:42,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:42,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:42,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:42,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:42,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:42,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:42,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:42,476 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:56:42,476 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:42,476 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:42,476 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,476 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:42,828 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,828 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,828 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:42,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:42,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:42,829 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:42,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:42,830 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:42,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:42,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,833 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,934 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:42,934 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:42,934 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:42,934 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,934 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:42,935 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,935 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:42,935 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,935 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,934 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:56:42,934 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:42,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:42,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:42,935 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:42,936 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:42,936 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:42,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:42,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:43,036 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:43,037 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:43,037 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:43,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:43,046 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:43,047 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:43,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:43,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:43,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:43,051 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:43,051 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:43,052 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:56:43,052 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:43,053 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:43,053 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:43,404 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:43,404 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:43,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:43,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:43,406 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:43,406 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:43,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:43,407 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:43,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:43,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:43,409 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:43,409 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:56:43,410 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:43,410 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:56:43,410 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:43,411 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:56:43,412 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:43,412 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:43,412 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:43,412 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. started... 2023-02-08 00:56:43,412 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 308c8dc09348dd627b816fb996c571a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:43,843 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101edfb199d1cca41aea8b41f9370da8292 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101edfb199d1cca41aea8b41f9370da8292 2023-02-08 00:56:44,251 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/e3e51c4c6b9e4245a0fcb29ca85088df 2023-02-08 00:56:44,261 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/e3e51c4c6b9e4245a0fcb29ca85088df as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/e3e51c4c6b9e4245a0fcb29ca85088df 2023-02-08 00:56:44,265 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/e3e51c4c6b9e4245a0fcb29ca85088df, entries=1, sequenceid=29, filesize=4.9 K 2023-02-08 00:56:44,266 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 308c8dc09348dd627b816fb996c571a1 in 854ms, sequenceid=29, compaction requested=true 2023-02-08 00:56:44,266 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 308c8dc09348dd627b816fb996c571a1: 2023-02-08 00:56:44,266 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:44,266 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:44,266 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:44,266 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,266 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:56:44,266 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:56:44,565 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,565 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:44,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:44,566 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,566 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:44,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:44,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:44,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:44,569 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:56:44,570 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4f266030[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:44,570 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:44,570 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,586 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,586 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,587 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:44,587 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:56:44,587 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:44,587 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,587 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:44,597 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:56:44,597 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,597 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:44,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:44,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:44,597 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:56:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:44,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:44,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:44,602 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:56:44,603 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:44,603 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:44,603 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,603 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:44,864 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,864 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:44,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:44,864 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:44,866 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:44,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:44,867 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:44,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:44,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,870 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:44,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,913 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,913 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:44,913 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,913 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:44,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:44,913 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:44,913 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:56:44,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:44,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:44,913 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:44,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:44,913 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,916 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:44,916 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:44,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:44,916 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:44,917 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,917 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:44,917 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:45,017 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:45,017 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:45,017 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:45,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:45,023 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:45,023 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:45,024 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:45,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:45,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:45,028 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:45,028 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:45,028 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:56:45,028 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:45,029 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:45,029 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:45,155 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:45,155 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:45,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:45,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:45,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:45,157 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:45,157 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:45,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:45,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:45,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:45,159 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:45,160 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:56:45,160 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:45,160 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:56:45,160 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:45,161 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:56:45,162 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:45,162 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:45,162 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:45,162 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. started... 2023-02-08 00:56:45,162 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 308c8dc09348dd627b816fb996c571a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:45,585 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030922048298ba4f88abad4fd5bdd345ae to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601030922048298ba4f88abad4fd5bdd345ae 2023-02-08 00:56:45,994 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/f084df2ee9dc4f0d8db0abc93df764e0 2023-02-08 00:56:46,004 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/f084df2ee9dc4f0d8db0abc93df764e0 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/f084df2ee9dc4f0d8db0abc93df764e0 2023-02-08 00:56:46,010 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/f084df2ee9dc4f0d8db0abc93df764e0, entries=1, sequenceid=33, filesize=4.9 K 2023-02-08 00:56:46,011 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 308c8dc09348dd627b816fb996c571a1 in 849ms, sequenceid=33, compaction requested=true 2023-02-08 00:56:46,011 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 308c8dc09348dd627b816fb996c571a1: 2023-02-08 00:56:46,011 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:46,011 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:46,011 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:46,011 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,011 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:56:46,011 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:56:46,281 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,281 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:46,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:46,282 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,282 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:46,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:46,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:46,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:56:46,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d2b6b95[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:46,287 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:46,287 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,376 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,376 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,377 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:46,377 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:56:46,377 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:46,377 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,377 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:46,418 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:56:46,419 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:46,419 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:56:46,419 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:46,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:46,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:46,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:46,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:46,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:46,428 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:46,428 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:56:46,428 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:46,428 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:46,428 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,428 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:46,471 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,471 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:46,471 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:46,472 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:46,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:46,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:46,473 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:46,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,476 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:46,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,787 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,787 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:46,787 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:46,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:46,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:46,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:46,787 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:56:46,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:46,789 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:46,789 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:46,787 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:46,788 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,791 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:46,791 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:46,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:46,791 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,792 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,792 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,889 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:46,890 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:46,890 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:46,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:46,898 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:46,898 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:46,900 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:46,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:46,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,903 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:46,903 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:46,904 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:56:46,904 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:46,905 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:46,905 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:47,260 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:47,260 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:47,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:47,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:47,262 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:47,262 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:47,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:47,263 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:47,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:47,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:47,265 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:47,265 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:56:47,265 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:47,265 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:56:47,265 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:47,267 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:56:47,267 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:47,267 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:47,267 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:47,268 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. started... 2023-02-08 00:56:47,268 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 308c8dc09348dd627b816fb996c571a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:47,686 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090762a41722a66c43e9a4e346b4ab8777de to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015090762a41722a66c43e9a4e346b4ab8777de 2023-02-08 00:56:48,093 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/0ec7cbce10d54e9391492eba0405f3f1 2023-02-08 00:56:48,102 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/0ec7cbce10d54e9391492eba0405f3f1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/0ec7cbce10d54e9391492eba0405f3f1 2023-02-08 00:56:48,111 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/0ec7cbce10d54e9391492eba0405f3f1, entries=1, sequenceid=37, filesize=4.9 K 2023-02-08 00:56:48,112 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 308c8dc09348dd627b816fb996c571a1 in 844ms, sequenceid=37, compaction requested=true 2023-02-08 00:56:48,112 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 308c8dc09348dd627b816fb996c571a1: 2023-02-08 00:56:48,112 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:48,112 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:48,112 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:48,112 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,112 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:56:48,112 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:56:48,418 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,418 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:48,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:48,419 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,419 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:48,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:48,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:48,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:48,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:56:48,425 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@627a009c[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:48,425 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:48,425 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,449 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,449 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,450 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:48,450 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:56:48,450 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:48,450 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,450 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:48,460 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,460 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:56:48,460 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:48,460 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:56:48,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:48,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:48,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:48,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:48,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:48,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:48,464 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:48,464 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:56:48,464 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:48,464 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:48,464 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,464 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:48,754 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,755 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:48,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:48,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,755 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:48,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:48,755 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:48,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:48,755 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:48,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,757 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:48,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,832 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,832 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:48,832 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,832 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:48,832 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:56:48,832 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,832 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:48,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:48,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:48,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:48,834 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:48,834 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:48,832 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:48,834 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:48,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:48,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:48,835 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,835 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,835 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,935 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:48,935 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:48,935 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:48,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:48,945 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:48,945 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:48,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:48,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:48,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,951 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:48,951 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:48,952 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:56:48,952 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:56:48,952 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:48,952 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:49,175 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:49,175 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:49,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:49,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:49,176 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:49,176 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:49,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:49,176 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:49,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:49,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:49,176 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:49,177 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:56:49,177 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:49,177 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:56:49,177 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:49,177 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:56:49,178 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:56:49,178 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:49,178 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:49,178 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. started... 2023-02-08 00:56:49,178 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 308c8dc09348dd627b816fb996c571a1 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:56:49,603 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120dffa9c8c725546a2946a7a84aa0a2750 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120dffa9c8c725546a2946a7a84aa0a2750 2023-02-08 00:56:50,010 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/1bd44c585d424619bc84a13b4979b339 2023-02-08 00:56:50,020 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/1bd44c585d424619bc84a13b4979b339 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1bd44c585d424619bc84a13b4979b339 2023-02-08 00:56:50,027 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1bd44c585d424619bc84a13b4979b339, entries=1, sequenceid=41, filesize=4.9 K 2023-02-08 00:56:50,028 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 308c8dc09348dd627b816fb996c571a1 in 850ms, sequenceid=41, compaction requested=true 2023-02-08 00:56:50,028 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 308c8dc09348dd627b816fb996c571a1: 2023-02-08 00:56:50,028 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:50,028 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:56:50,028 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:56:50,028 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,028 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:56:50,029 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:56:50,213 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,213 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:50,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:50,214 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,214 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:50,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:50,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:50,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:50,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:56:50,216 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4465d69d[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:50,216 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:56:50,216 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,245 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,246 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:56:50,246 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:56:50,246 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:50,246 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,246 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:50,270 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:56:50,270 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,270 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:50,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:50,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:50,270 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:56:50,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:50,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:50,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:50,273 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:56:50,273 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:50,274 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:50,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:56:50,274 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,274 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:50,571 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,572 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,572 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,572 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:50,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:50,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:50,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:50,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:50,574 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:50,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:50,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,578 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:50,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,607 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:50,607 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:50,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:50,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:50,607 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-02-08 00:56:50,607 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:50,607 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:50,607 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:50,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:50,608 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:50,608 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:56:50,608 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,609 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:50,609 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:50,609 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,609 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,609 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,709 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:50,709 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:50,709 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:50,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:50,714 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-02-08 00:56:50,718 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 00:56:50,719 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 00:56:50,721 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818410721 2023-02-08 00:56:50,721 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:56:50,724 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-08 00:56:50,726 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-08 00:56:50,726 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 00:56:50,726 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x2eeacc59 to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:56:50,994 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1423000f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:56:50,994 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:56:51,856 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010390d19fd3526f4bfc92c56dd69be1d251 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010390d19fd3526f4bfc92c56dd69be1d251 2023-02-08 00:56:51,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 00:56:51,868 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:56:51,869 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:55176, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:56:51,875 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:51,875 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:51,876 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:56:51,878 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:48330, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:56:51,887 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/33c1c0d3f3b34671bcb60379573a35b2 first=Optional[r3] last=Optional[r6] 2023-02-08 00:56:51,888 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/33c1c0d3f3b34671bcb60379573a35b2}] 2023-02-08 00:56:51,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/33c1c0d3f3b34671bcb60379573a35b2 for inclusion in 308c8dc09348dd627b816fb996c571a1/family1 2023-02-08 00:56:51,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-08 00:56:51,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:56:51,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 308c8dc09348dd627b816fb996c571a1: 2023-02-08 00:56:51,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/33c1c0d3f3b34671bcb60379573a35b2 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cllp7bkvd7ouqclqeinth0vcem6eudhk4q8p1opqruih46o1pjv6bocmb0eo1hve/family1/33c1c0d3f3b34671bcb60379573a35b2 2023-02-08 00:56:51,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cllp7bkvd7ouqclqeinth0vcem6eudhk4q8p1opqruih46o1pjv6bocmb0eo1hve/family1/33c1c0d3f3b34671bcb60379573a35b2 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/6cfaceb8d23c4640abc3b151a1827c33_SeqId_44_ 2023-02-08 00:56:51,902 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cllp7bkvd7ouqclqeinth0vcem6eudhk4q8p1opqruih46o1pjv6bocmb0eo1hve/family1/33c1c0d3f3b34671bcb60379573a35b2 into 308c8dc09348dd627b816fb996c571a1/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/6cfaceb8d23c4640abc3b151a1827c33_SeqId_44_ - updating store file list. 2023-02-08 00:56:51,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/6cfaceb8d23c4640abc3b151a1827c33_SeqId_44_ into 308c8dc09348dd627b816fb996c571a1/family1 2023-02-08 00:56:51,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cllp7bkvd7ouqclqeinth0vcem6eudhk4q8p1opqruih46o1pjv6bocmb0eo1hve/family1/33c1c0d3f3b34671bcb60379573a35b2 into 308c8dc09348dd627b816fb996c571a1/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/6cfaceb8d23c4640abc3b151a1827c33_SeqId_44_) 2023-02-08 00:56:51,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithWeeklyPolicy__cllp7bkvd7ouqclqeinth0vcem6eudhk4q8p1opqruih46o1pjv6bocmb0eo1hve/family1/33c1c0d3f3b34671bcb60379573a35b2 2023-02-08 00:56:51,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-08 00:56:51,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-08 00:56:51,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 308c8dc09348dd627b816fb996c571a1/family1 is initiating minor compaction 2023-02-08 00:56:51,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@206e607; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:56:51,911 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 308c8dc09348dd627b816fb996c571a1/family1 in testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:51,912 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/d6feeca6eec74bbf99ff9adcc613b0ef, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/c9f65e2a89d84de49b3ccb82cfdb23e0, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/d6b3645de4434e94a6061b7914935cd3, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/4e89557638b848f8937f78e4fe76ac7b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1570e8b66c9049faa3654568725f2c97, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/e3e51c4c6b9e4245a0fcb29ca85088df, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/f084df2ee9dc4f0d8db0abc93df764e0, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/0ec7cbce10d54e9391492eba0405f3f1, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1bd44c585d424619bc84a13b4979b339, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/6cfaceb8d23c4640abc3b151a1827c33_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp, totalSize=50.0 K 2023-02-08 00:56:51,912 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting d6feeca6eec74bbf99ff9adcc613b0ef, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 00:56:51,912 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting c9f65e2a89d84de49b3ccb82cfdb23e0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 00:56:51,912 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting d6b3645de4434e94a6061b7914935cd3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-08 00:56:51,912 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 4e89557638b848f8937f78e4fe76ac7b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-08 00:56:51,912 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 1570e8b66c9049faa3654568725f2c97, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-08 00:56:51,912 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting e3e51c4c6b9e4245a0fcb29ca85088df, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-08 00:56:51,912 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting f084df2ee9dc4f0d8db0abc93df764e0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-08 00:56:51,912 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 0ec7cbce10d54e9391492eba0405f3f1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-08 00:56:51,912 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 1bd44c585d424619bc84a13b4979b339, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-08 00:56:51,912 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 6cfaceb8d23c4640abc3b151a1827c33_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-08 00:56:51,914 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 00:56:51,915 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:56:51,916 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228a3d3a7fe4a0741c4a6e40bd664337f28 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228a3d3a7fe4a0741c4a6e40bd664337f28 2023-02-08 00:56:51,917 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231e7d7636a2ff341dbacb56e0a02361e52 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231e7d7636a2ff341dbacb56e0a02361e52 2023-02-08 00:56:51,918 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101edfb199d1cca41aea8b41f9370da8292 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160101edfb199d1cca41aea8b41f9370da8292 2023-02-08 00:56:51,919 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601030922048298ba4f88abad4fd5bdd345ae to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601030922048298ba4f88abad4fd5bdd345ae 2023-02-08 00:56:51,919 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-08 00:56:51,919 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-08 00:56:51,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:56:51,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:56:51,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:56:51,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:56:51,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:56:51,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:56:51,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:56:51,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:56:51,947 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 308c8dc09348dd627b816fb996c571a1#family1#compaction#34 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:56:52,763 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512058145c4a0f60d48ca9c6727cedfc1b922 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512058145c4a0f60d48ca9c6727cedfc1b922 2023-02-08 00:56:52,764 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 00:56:52,768 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/727ad43c4f544e3bac0a41fb281c6286 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/727ad43c4f544e3bac0a41fb281c6286 2023-02-08 00:56:52,773 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 308c8dc09348dd627b816fb996c571a1/family1 of 308c8dc09348dd627b816fb996c571a1 into 727ad43c4f544e3bac0a41fb281c6286(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:56:52,773 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 308c8dc09348dd627b816fb996c571a1: 2023-02-08 00:56:52,773 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1675817811911; duration=0sec 2023-02-08 00:56:52,774 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:56:52,781 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:52,781 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:52,788 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e908ef868df144ef82356c1786024679 first=Optional[r1] last=Optional[r2] 2023-02-08 00:56:52,789 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e908ef868df144ef82356c1786024679}] 2023-02-08 00:56:52,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e908ef868df144ef82356c1786024679 for inclusion in 308c8dc09348dd627b816fb996c571a1/family1 2023-02-08 00:56:52,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-08 00:56:52,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:56:52,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 308c8dc09348dd627b816fb996c571a1: 2023-02-08 00:56:52,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/e908ef868df144ef82356c1786024679 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nsbh0ff0tujthafc2c9gf27a8o73fcod6i7u93ma5v6ufa7m8r3ck581ia8q9l3/family1/e908ef868df144ef82356c1786024679 2023-02-08 00:56:52,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nsbh0ff0tujthafc2c9gf27a8o73fcod6i7u93ma5v6ufa7m8r3ck581ia8q9l3/family1/e908ef868df144ef82356c1786024679 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1351c079b6cb437782158d5687f223aa_SeqId_47_ 2023-02-08 00:56:52,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nsbh0ff0tujthafc2c9gf27a8o73fcod6i7u93ma5v6ufa7m8r3ck581ia8q9l3/family1/e908ef868df144ef82356c1786024679 into 308c8dc09348dd627b816fb996c571a1/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1351c079b6cb437782158d5687f223aa_SeqId_47_ - updating store file list. 2023-02-08 00:56:52,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1351c079b6cb437782158d5687f223aa_SeqId_47_ into 308c8dc09348dd627b816fb996c571a1/family1 2023-02-08 00:56:52,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nsbh0ff0tujthafc2c9gf27a8o73fcod6i7u93ma5v6ufa7m8r3ck581ia8q9l3/family1/e908ef868df144ef82356c1786024679 into 308c8dc09348dd627b816fb996c571a1/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1351c079b6cb437782158d5687f223aa_SeqId_47_) 2023-02-08 00:56:52,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithWeeklyPolicy__nsbh0ff0tujthafc2c9gf27a8o73fcod6i7u93ma5v6ufa7m8r3ck581ia8q9l3/family1/e908ef868df144ef82356c1786024679 2023-02-08 00:56:52,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 00:56:52,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 00:56:52,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 308c8dc09348dd627b816fb996c571a1/family1 is initiating minor compaction (all files) 2023-02-08 00:56:52,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@482cbddf; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-08 00:56:52,807 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 308c8dc09348dd627b816fb996c571a1/family1 in testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 00:56:52,807 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/e3a8f0cf86d54d5e9195b96def077dd2, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/727ad43c4f544e3bac0a41fb281c6286, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1351c079b6cb437782158d5687f223aa_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp, totalSize=176.8 K 2023-02-08 00:56:52,807 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting e3a8f0cf86d54d5e9195b96def077dd2, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878836759 2023-02-08 00:56:52,808 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 727ad43c4f544e3bac0a41fb281c6286, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621236759 2023-02-08 00:56:52,808 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 1351c079b6cb437782158d5687f223aa_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965236759 2023-02-08 00:56:52,809 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 00:56:52,809 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:56:52,811 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512017500d06b52c14786853def4b65b08590 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512017500d06b52c14786853def4b65b08590 2023-02-08 00:56:52,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205171e987cca0d4c7f83783f09f6911368 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205171e987cca0d4c7f83783f09f6911368 2023-02-08 00:56:52,813 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-02-08 00:56:52,813 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-08 00:56:52,813 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:56:52,813 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 00:56:52,813 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:56:52,814 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 00:56:52,816 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 2.0980 sec 2023-02-08 00:56:52,829 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/d6feeca6eec74bbf99ff9adcc613b0ef, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/c9f65e2a89d84de49b3ccb82cfdb23e0, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/d6b3645de4434e94a6061b7914935cd3, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/4e89557638b848f8937f78e4fe76ac7b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1570e8b66c9049faa3654568725f2c97, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/e3e51c4c6b9e4245a0fcb29ca85088df, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/f084df2ee9dc4f0d8db0abc93df764e0, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/0ec7cbce10d54e9391492eba0405f3f1, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1bd44c585d424619bc84a13b4979b339, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/6cfaceb8d23c4640abc3b151a1827c33_SeqId_44_] to archive 2023-02-08 00:56:52,830 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:56:52,832 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/d6feeca6eec74bbf99ff9adcc613b0ef to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/d6feeca6eec74bbf99ff9adcc613b0ef 2023-02-08 00:56:52,833 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/c9f65e2a89d84de49b3ccb82cfdb23e0 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/c9f65e2a89d84de49b3ccb82cfdb23e0 2023-02-08 00:56:52,835 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/d6b3645de4434e94a6061b7914935cd3 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/d6b3645de4434e94a6061b7914935cd3 2023-02-08 00:56:52,837 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/4e89557638b848f8937f78e4fe76ac7b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/4e89557638b848f8937f78e4fe76ac7b 2023-02-08 00:56:52,839 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1570e8b66c9049faa3654568725f2c97 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1570e8b66c9049faa3654568725f2c97 2023-02-08 00:56:52,839 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 308c8dc09348dd627b816fb996c571a1#family1#compaction#35 average throughput is 9.67 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:56:52,840 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/e3e51c4c6b9e4245a0fcb29ca85088df to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/e3e51c4c6b9e4245a0fcb29ca85088df 2023-02-08 00:56:52,843 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/f084df2ee9dc4f0d8db0abc93df764e0 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/f084df2ee9dc4f0d8db0abc93df764e0 2023-02-08 00:56:52,844 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/0ec7cbce10d54e9391492eba0405f3f1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/0ec7cbce10d54e9391492eba0405f3f1 2023-02-08 00:56:52,846 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1bd44c585d424619bc84a13b4979b339 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1bd44c585d424619bc84a13b4979b339 2023-02-08 00:56:52,847 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/6cfaceb8d23c4640abc3b151a1827c33_SeqId_44_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/6cfaceb8d23c4640abc3b151a1827c33_SeqId_44_ 2023-02-08 00:56:52,857 DEBUG [hfile_cleaner-dir-scan-pool-0] cleaner.CleanerChore(483): Couldn't delete 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1' yet because it isn't empty w/exception. org.apache.hadoop.fs.PathIsNotEmptyDirectoryException: ``/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) ': Directory is not empty: `/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1595) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:881) at org.apache.hadoop.hdfs.DistributedFileSystem$19.doCall(DistributedFileSystem.java:878) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.delete(DistributedFileSystem.java:878) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$4(CleanerChore.java:453) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.deleteAction(CleanerChore.java:478) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$traverseAndDelete$5(CleanerChore.java:453) at org.apache.hadoop.hbase.util.FutureUtils.lambda$addListener$0(FutureUtils.java:68) at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:774) at java.util.concurrent.CompletableFuture.uniWhenCompleteStage(CompletableFuture.java:792) at java.util.concurrent.CompletableFuture.whenComplete(CompletableFuture.java:2153) at org.apache.hadoop.hbase.util.FutureUtils.addListener(FutureUtils.java:61) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.traverseAndDelete(CleanerChore.java:439) at org.apache.hadoop.hbase.master.cleaner.CleanerChore.lambda$null$2(CleanerChore.java:432) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.fs.PathIsNotEmptyDirectoryException): `/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1 is non empty': Directory is not empty at org.apache.hadoop.hdfs.server.namenode.FSDirDeleteOp.delete(FSDirDeleteOp.java:115) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.delete(FSNamesystem.java:2873) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.delete(NameNodeRpcServer.java:1101) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.delete(ClientNamenodeProtocolServerSideTranslatorPB.java:648) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.delete(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.delete(ClientNamenodeProtocolTranslatorPB.java:572) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at sun.reflect.GeneratedMethodAccessor8.invoke(Unknown Source) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.delete(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.delete(DFSClient.java:1593) ... 17 more 2023-02-08 00:56:52,927 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=241 (was 239) - Thread LEAK? -, OpenFileDescriptor=577 (was 582), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=282 (was 308), ProcessCount=175 (was 175), AvailableMemoryMB=3507 (was 3510) 2023-02-08 00:56:52,939 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=241, OpenFileDescriptor=577, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=175, AvailableMemoryMB=3507 2023-02-08 00:56:52,940 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:52,940 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:52,942 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-08 00:56:52,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:52,945 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 00:56:52,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-02-08 00:56:52,945 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:52,946 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:52,946 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 00:56:52,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-08 00:56:52,948 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b50089805dc4677867e1dbc0df92d93d 2023-02-08 00:56:52,948 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3b0ead07198c1a0973ebc9c72e876b7b 2023-02-08 00:56:52,948 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a 2023-02-08 00:56:52,948 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b50089805dc4677867e1dbc0df92d93d empty. 2023-02-08 00:56:52,949 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a empty. 2023-02-08 00:56:52,949 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3b0ead07198c1a0973ebc9c72e876b7b empty. 2023-02-08 00:56:52,949 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testScannerOnBulkLoadRefHFiles/b50089805dc4677867e1dbc0df92d93d 2023-02-08 00:56:52,949 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3b0ead07198c1a0973ebc9c72e876b7b 2023-02-08 00:56:52,949 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a 2023-02-08 00:56:52,949 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-02-08 00:56:52,961 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-02-08 00:56:52,963 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7671): creating {ENCODED => cafd9b0cf7097e09cf9b7e7ea6e8da0a, NAME => 'testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:56:52,964 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7671): creating {ENCODED => 3b0ead07198c1a0973ebc9c72e876b7b, NAME => 'testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:56:52,964 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7671): creating {ENCODED => b50089805dc4677867e1dbc0df92d93d, NAME => 'testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:56:52,976 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:56:52,976 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1603): Closing b50089805dc4677867e1dbc0df92d93d, disabling compactions & flushes 2023-02-08 00:56:52,976 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 00:56:52,976 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 00:56:52,976 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. after waiting 0 ms 2023-02-08 00:56:52,976 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 00:56:52,976 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 00:56:52,976 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1557): Region close journal for b50089805dc4677867e1dbc0df92d93d: Waiting for close lock at 1675817812976Disabling compacts and flushes for region at 1675817812976Disabling writes for close at 1675817812976Writing region close event to WAL at 1675817812976Closed at 1675817812976 2023-02-08 00:56:53,047 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:53,047 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:53,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-08 00:56:53,249 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:53,250 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:53,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-08 00:56:53,261 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/.tmp/family1/80d6a6f031214d118abe7b9faed784a2 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/80d6a6f031214d118abe7b9faed784a2 2023-02-08 00:56:53,266 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 308c8dc09348dd627b816fb996c571a1/family1 of 308c8dc09348dd627b816fb996c571a1 into 80d6a6f031214d118abe7b9faed784a2(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:56:53,266 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 308c8dc09348dd627b816fb996c571a1: 2023-02-08 00:56:53,266 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1675817812807; duration=0sec 2023-02-08 00:56:53,267 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:56:53,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/e3a8f0cf86d54d5e9195b96def077dd2, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/727ad43c4f544e3bac0a41fb281c6286, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1351c079b6cb437782158d5687f223aa_SeqId_47_] to archive 2023-02-08 00:56:53,324 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:56:53,326 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/e3a8f0cf86d54d5e9195b96def077dd2 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/e3a8f0cf86d54d5e9195b96def077dd2 2023-02-08 00:56:53,328 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/727ad43c4f544e3bac0a41fb281c6286 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/727ad43c4f544e3bac0a41fb281c6286 2023-02-08 00:56:53,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1351c079b6cb437782158d5687f223aa_SeqId_47_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/family1/1351c079b6cb437782158d5687f223aa_SeqId_47_ 2023-02-08 00:56:53,380 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:56:53,380 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1603): Closing cafd9b0cf7097e09cf9b7e7ea6e8da0a, disabling compactions & flushes 2023-02-08 00:56:53,380 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 00:56:53,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 00:56:53,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. after waiting 0 ms 2023-02-08 00:56:53,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 00:56:53,381 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 00:56:53,381 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1557): Region close journal for cafd9b0cf7097e09cf9b7e7ea6e8da0a: Waiting for close lock at 1675817813380Disabling compacts and flushes for region at 1675817813380Disabling writes for close at 1675817813381 (+1 ms)Writing region close event to WAL at 1675817813381Closed at 1675817813381 2023-02-08 00:56:53,382 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:56:53,383 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1603): Closing 3b0ead07198c1a0973ebc9c72e876b7b, disabling compactions & flushes 2023-02-08 00:56:53,383 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 00:56:53,383 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 00:56:53,383 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. after waiting 0 ms 2023-02-08 00:56:53,383 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 00:56:53,383 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 00:56:53,383 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1557): Region close journal for 3b0ead07198c1a0973ebc9c72e876b7b: Waiting for close lock at 1675817813382Disabling compacts and flushes for region at 1675817813382Disabling writes for close at 1675817813383 (+1 ms)Writing region close event to WAL at 1675817813383Closed at 1675817813383 2023-02-08 00:56:53,387 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 00:56:53,389 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675817813389"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817813389"}]},"ts":"1675817813389"} 2023-02-08 00:56:53,390 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675817813389"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817813389"}]},"ts":"1675817813389"} 2023-02-08 00:56:53,390 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675817813389"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817813389"}]},"ts":"1675817813389"} 2023-02-08 00:56:53,393 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-08 00:56:53,394 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 00:56:53,394 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817813394"}]},"ts":"1675817813394"} 2023-02-08 00:56:53,395 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-02-08 00:56:53,541 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b50089805dc4677867e1dbc0df92d93d, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3b0ead07198c1a0973ebc9c72e876b7b, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cafd9b0cf7097e09cf9b7e7ea6e8da0a, ASSIGN}] 2023-02-08 00:56:53,546 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3b0ead07198c1a0973ebc9c72e876b7b, ASSIGN 2023-02-08 00:56:53,547 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b50089805dc4677867e1dbc0df92d93d, ASSIGN 2023-02-08 00:56:53,547 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cafd9b0cf7097e09cf9b7e7ea6e8da0a, ASSIGN 2023-02-08 00:56:53,548 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3b0ead07198c1a0973ebc9c72e876b7b, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:56:53,548 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b50089805dc4677867e1dbc0df92d93d, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:56:53,548 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cafd9b0cf7097e09cf9b7e7ea6e8da0a, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:56:53,551 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:53,551 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:53,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-08 00:56:53,701 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=cafd9b0cf7097e09cf9b7e7ea6e8da0a, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:53,702 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b50089805dc4677867e1dbc0df92d93d, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:53,702 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=3b0ead07198c1a0973ebc9c72e876b7b, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:53,702 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675817813701"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817813701"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817813701"}]},"ts":"1675817813701"} 2023-02-08 00:56:53,703 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675817813701"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817813701"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817813701"}]},"ts":"1675817813701"} 2023-02-08 00:56:53,702 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675817813701"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817813701"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817813701"}]},"ts":"1675817813701"} 2023-02-08 00:56:53,705 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure cafd9b0cf7097e09cf9b7e7ea6e8da0a, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:56:53,706 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=32, ppid=29, state=RUNNABLE; OpenRegionProcedure 3b0ead07198c1a0973ebc9c72e876b7b, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:56:53,707 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=33, ppid=28, state=RUNNABLE; OpenRegionProcedure b50089805dc4677867e1dbc0df92d93d, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:56:53,862 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 00:56:53,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cafd9b0cf7097e09cf9b7e7ea6e8da0a, NAME => 'testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a.', STARTKEY => '2', ENDKEY => ''} 2023-02-08 00:56:53,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles cafd9b0cf7097e09cf9b7e7ea6e8da0a 2023-02-08 00:56:53,863 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:56:53,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for cafd9b0cf7097e09cf9b7e7ea6e8da0a 2023-02-08 00:56:53,864 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for cafd9b0cf7097e09cf9b7e7ea6e8da0a 2023-02-08 00:56:53,866 INFO [StoreOpener-cafd9b0cf7097e09cf9b7e7ea6e8da0a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cafd9b0cf7097e09cf9b7e7ea6e8da0a 2023-02-08 00:56:53,868 DEBUG [StoreOpener-cafd9b0cf7097e09cf9b7e7ea6e8da0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1 2023-02-08 00:56:53,868 DEBUG [StoreOpener-cafd9b0cf7097e09cf9b7e7ea6e8da0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1 2023-02-08 00:56:53,869 INFO [StoreOpener-cafd9b0cf7097e09cf9b7e7ea6e8da0a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cafd9b0cf7097e09cf9b7e7ea6e8da0a columnFamilyName family1 2023-02-08 00:56:53,871 INFO [StoreOpener-cafd9b0cf7097e09cf9b7e7ea6e8da0a-1] regionserver.HStore(310): Store=cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:56:53,871 INFO [StoreOpener-cafd9b0cf7097e09cf9b7e7ea6e8da0a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region cafd9b0cf7097e09cf9b7e7ea6e8da0a 2023-02-08 00:56:53,873 DEBUG [StoreOpener-cafd9b0cf7097e09cf9b7e7ea6e8da0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family2 2023-02-08 00:56:53,873 DEBUG [StoreOpener-cafd9b0cf7097e09cf9b7e7ea6e8da0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family2 2023-02-08 00:56:53,873 INFO [StoreOpener-cafd9b0cf7097e09cf9b7e7ea6e8da0a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cafd9b0cf7097e09cf9b7e7ea6e8da0a columnFamilyName family2 2023-02-08 00:56:53,874 INFO [StoreOpener-cafd9b0cf7097e09cf9b7e7ea6e8da0a-1] regionserver.HStore(310): Store=cafd9b0cf7097e09cf9b7e7ea6e8da0a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:56:53,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a 2023-02-08 00:56:53,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a 2023-02-08 00:56:53,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:56:53,877 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for cafd9b0cf7097e09cf9b7e7ea6e8da0a 2023-02-08 00:56:53,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:56:53,879 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened cafd9b0cf7097e09cf9b7e7ea6e8da0a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59643874, jitterRate=-0.11123701930046082}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:56:53,879 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for cafd9b0cf7097e09cf9b7e7ea6e8da0a: Running coprocessor pre-open hook at 1675817813864Writing region info on filesystem at 1675817813864Initializing all the Stores at 1675817813865 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817813865Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817813866 (+1 ms)Cleaning up temporary data from old regions at 1675817813876 (+10 ms)Cleaning up detritus from prior splits at 1675817813876Running coprocessor post-open hooks at 1675817813879 (+3 ms)Region opened successfully at 1675817813879 2023-02-08 00:56:53,880 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a., pid=31, masterSystemTime=1675817813858 2023-02-08 00:56:53,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 00:56:53,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 00:56:53,882 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 00:56:53,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => b50089805dc4677867e1dbc0df92d93d, NAME => 'testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d.', STARTKEY => '', ENDKEY => '1'} 2023-02-08 00:56:53,882 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=cafd9b0cf7097e09cf9b7e7ea6e8da0a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:53,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles b50089805dc4677867e1dbc0df92d93d 2023-02-08 00:56:53,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:56:53,882 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675817813882"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817813882"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817813882"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817813882"}]},"ts":"1675817813882"} 2023-02-08 00:56:53,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for b50089805dc4677867e1dbc0df92d93d 2023-02-08 00:56:53,882 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for b50089805dc4677867e1dbc0df92d93d 2023-02-08 00:56:53,884 INFO [StoreOpener-b50089805dc4677867e1dbc0df92d93d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b50089805dc4677867e1dbc0df92d93d 2023-02-08 00:56:53,885 DEBUG [StoreOpener-b50089805dc4677867e1dbc0df92d93d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/b50089805dc4677867e1dbc0df92d93d/family1 2023-02-08 00:56:53,885 DEBUG [StoreOpener-b50089805dc4677867e1dbc0df92d93d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/b50089805dc4677867e1dbc0df92d93d/family1 2023-02-08 00:56:53,885 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=30 2023-02-08 00:56:53,886 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure cafd9b0cf7097e09cf9b7e7ea6e8da0a, server=jenkins-hbase12.apache.org,36907,1675817727419 in 179 msec 2023-02-08 00:56:53,886 INFO [StoreOpener-b50089805dc4677867e1dbc0df92d93d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b50089805dc4677867e1dbc0df92d93d columnFamilyName family1 2023-02-08 00:56:53,887 INFO [StoreOpener-b50089805dc4677867e1dbc0df92d93d-1] regionserver.HStore(310): Store=b50089805dc4677867e1dbc0df92d93d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:56:53,887 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=cafd9b0cf7097e09cf9b7e7ea6e8da0a, ASSIGN in 345 msec 2023-02-08 00:56:53,887 INFO [StoreOpener-b50089805dc4677867e1dbc0df92d93d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b50089805dc4677867e1dbc0df92d93d 2023-02-08 00:56:53,889 DEBUG [StoreOpener-b50089805dc4677867e1dbc0df92d93d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/b50089805dc4677867e1dbc0df92d93d/family2 2023-02-08 00:56:53,889 DEBUG [StoreOpener-b50089805dc4677867e1dbc0df92d93d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/b50089805dc4677867e1dbc0df92d93d/family2 2023-02-08 00:56:53,889 INFO [StoreOpener-b50089805dc4677867e1dbc0df92d93d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b50089805dc4677867e1dbc0df92d93d columnFamilyName family2 2023-02-08 00:56:53,890 INFO [StoreOpener-b50089805dc4677867e1dbc0df92d93d-1] regionserver.HStore(310): Store=b50089805dc4677867e1dbc0df92d93d/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:56:53,891 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/b50089805dc4677867e1dbc0df92d93d 2023-02-08 00:56:53,892 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/b50089805dc4677867e1dbc0df92d93d 2023-02-08 00:56:53,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:56:53,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for b50089805dc4677867e1dbc0df92d93d 2023-02-08 00:56:53,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/b50089805dc4677867e1dbc0df92d93d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:56:53,897 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened b50089805dc4677867e1dbc0df92d93d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66065930, jitterRate=-0.015540927648544312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:56:53,897 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for b50089805dc4677867e1dbc0df92d93d: Running coprocessor pre-open hook at 1675817813882Writing region info on filesystem at 1675817813882Initializing all the Stores at 1675817813883 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817813883Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817813884 (+1 ms)Cleaning up temporary data from old regions at 1675817813892 (+8 ms)Cleaning up detritus from prior splits at 1675817813893 (+1 ms)Running coprocessor post-open hooks at 1675817813897 (+4 ms)Region opened successfully at 1675817813897 2023-02-08 00:56:53,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d., pid=33, masterSystemTime=1675817813858 2023-02-08 00:56:53,899 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 00:56:53,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 00:56:53,899 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 00:56:53,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3b0ead07198c1a0973ebc9c72e876b7b, NAME => 'testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b.', STARTKEY => '1', ENDKEY => '2'} 2023-02-08 00:56:53,900 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b50089805dc4677867e1dbc0df92d93d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:53,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 3b0ead07198c1a0973ebc9c72e876b7b 2023-02-08 00:56:53,900 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1675817813900"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817813900"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817813900"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817813900"}]},"ts":"1675817813900"} 2023-02-08 00:56:53,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:56:53,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 3b0ead07198c1a0973ebc9c72e876b7b 2023-02-08 00:56:53,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 3b0ead07198c1a0973ebc9c72e876b7b 2023-02-08 00:56:53,901 INFO [StoreOpener-3b0ead07198c1a0973ebc9c72e876b7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3b0ead07198c1a0973ebc9c72e876b7b 2023-02-08 00:56:53,903 DEBUG [StoreOpener-3b0ead07198c1a0973ebc9c72e876b7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/3b0ead07198c1a0973ebc9c72e876b7b/family1 2023-02-08 00:56:53,903 DEBUG [StoreOpener-3b0ead07198c1a0973ebc9c72e876b7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/3b0ead07198c1a0973ebc9c72e876b7b/family1 2023-02-08 00:56:53,903 INFO [StoreOpener-3b0ead07198c1a0973ebc9c72e876b7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b0ead07198c1a0973ebc9c72e876b7b columnFamilyName family1 2023-02-08 00:56:53,903 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=33, resume processing ppid=28 2023-02-08 00:56:53,904 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, ppid=28, state=SUCCESS; OpenRegionProcedure b50089805dc4677867e1dbc0df92d93d, server=jenkins-hbase12.apache.org,36907,1675817727419 in 194 msec 2023-02-08 00:56:53,904 INFO [StoreOpener-3b0ead07198c1a0973ebc9c72e876b7b-1] regionserver.HStore(310): Store=3b0ead07198c1a0973ebc9c72e876b7b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:56:53,905 INFO [StoreOpener-3b0ead07198c1a0973ebc9c72e876b7b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3b0ead07198c1a0973ebc9c72e876b7b 2023-02-08 00:56:53,905 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=b50089805dc4677867e1dbc0df92d93d, ASSIGN in 363 msec 2023-02-08 00:56:53,906 DEBUG [StoreOpener-3b0ead07198c1a0973ebc9c72e876b7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/3b0ead07198c1a0973ebc9c72e876b7b/family2 2023-02-08 00:56:53,906 DEBUG [StoreOpener-3b0ead07198c1a0973ebc9c72e876b7b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/3b0ead07198c1a0973ebc9c72e876b7b/family2 2023-02-08 00:56:53,907 INFO [StoreOpener-3b0ead07198c1a0973ebc9c72e876b7b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b0ead07198c1a0973ebc9c72e876b7b columnFamilyName family2 2023-02-08 00:56:53,907 INFO [StoreOpener-3b0ead07198c1a0973ebc9c72e876b7b-1] regionserver.HStore(310): Store=3b0ead07198c1a0973ebc9c72e876b7b/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:56:53,908 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/3b0ead07198c1a0973ebc9c72e876b7b 2023-02-08 00:56:53,909 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/3b0ead07198c1a0973ebc9c72e876b7b 2023-02-08 00:56:53,910 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:56:53,911 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 3b0ead07198c1a0973ebc9c72e876b7b 2023-02-08 00:56:53,913 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/3b0ead07198c1a0973ebc9c72e876b7b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:56:53,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 3b0ead07198c1a0973ebc9c72e876b7b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74344036, jitterRate=0.10781246423721313}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:56:53,914 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 3b0ead07198c1a0973ebc9c72e876b7b: Running coprocessor pre-open hook at 1675817813900Writing region info on filesystem at 1675817813900Initializing all the Stores at 1675817813901 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817813901Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817813901Cleaning up temporary data from old regions at 1675817813909 (+8 ms)Cleaning up detritus from prior splits at 1675817813909Running coprocessor post-open hooks at 1675817813914 (+5 ms)Region opened successfully at 1675817813914 2023-02-08 00:56:53,914 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b., pid=32, masterSystemTime=1675817813858 2023-02-08 00:56:53,916 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 00:56:53,916 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 00:56:53,916 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=3b0ead07198c1a0973ebc9c72e876b7b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:53,917 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1675817813916"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817813916"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817813916"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817813916"}]},"ts":"1675817813916"} 2023-02-08 00:56:53,920 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=32, resume processing ppid=29 2023-02-08 00:56:53,920 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, ppid=29, state=SUCCESS; OpenRegionProcedure 3b0ead07198c1a0973ebc9c72e876b7b, server=jenkins-hbase12.apache.org,36907,1675817727419 in 212 msec 2023-02-08 00:56:53,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-02-08 00:56:53,921 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3b0ead07198c1a0973ebc9c72e876b7b, ASSIGN in 379 msec 2023-02-08 00:56:53,922 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 00:56:53,922 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817813922"}]},"ts":"1675817813922"} 2023-02-08 00:56:53,923 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-02-08 00:56:54,005 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 00:56:54,008 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.0630 sec 2023-02-08 00:56:54,052 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:54,053 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:54,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=27 2023-02-08 00:56:54,055 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-02-08 00:56:54,066 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:54,066 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:54,067 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:54,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,070 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-08 00:56:54,071 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:54,071 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-08 00:56:54,071 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-08 00:56:54,072 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,072 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,112 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:54,112 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:54,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:54,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:54,113 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:54,113 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:54,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,114 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:54,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,115 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,115 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,116 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-08 00:56:54,116 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:54,116 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-08 00:56:54,118 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 00:56:54,118 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 00:56:54,118 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 00:56:54,118 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. started... 2023-02-08 00:56:54,118 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. started... 2023-02-08 00:56:54,118 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:56:54,118 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:54,118 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. started... 2023-02-08 00:56:54,119 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cafd9b0cf7097e09cf9b7e7ea6e8da0a 2/2 column families, dataSize=48 B heapSize=632 B 2023-02-08 00:56:54,120 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b50089805dc4677867e1dbc0df92d93d: 2023-02-08 00:56:54,119 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3b0ead07198c1a0973ebc9c72e876b7b: 2023-02-08 00:56:54,120 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 00:56:54,120 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 00:56:54,120 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:56:54,120 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:56:54,537 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020813d1c96fb9de46e3b9e5a016c891299f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023020813d1c96fb9de46e3b9e5a016c891299f 2023-02-08 00:56:54,542 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/.tmp/family1/453cd3aefd5b46d8805b43008add1343 2023-02-08 00:56:54,548 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/.tmp/family1/453cd3aefd5b46d8805b43008add1343 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/453cd3aefd5b46d8805b43008add1343 2023-02-08 00:56:54,553 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/453cd3aefd5b46d8805b43008add1343, entries=1, sequenceid=5, filesize=4.9 K 2023-02-08 00:56:54,554 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for cafd9b0cf7097e09cf9b7e7ea6e8da0a in 435ms, sequenceid=5, compaction requested=false 2023-02-08 00:56:54,554 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-02-08 00:56:54,555 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cafd9b0cf7097e09cf9b7e7ea6e8da0a: 2023-02-08 00:56:54,555 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 00:56:54,555 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:56:54,555 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:56:54,555 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:54,555 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-08 00:56:54,555 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-08 00:56:54,866 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:54,866 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:54,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:54,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:54,867 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,867 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:54,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:54,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:54,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-08 00:56:54,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@383e19c1[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:54,872 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-08 00:56:54,872 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,897 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,898 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-08 00:56:54,898 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-08 00:56:54,898 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:54,898 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:54,898 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:54,918 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-08 00:56:54,918 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:54,919 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-08 00:56:54,918 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:54,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:54,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:54,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:54,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:54,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:54,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:54,923 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-08 00:56:54,923 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-08 00:56:54,923 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:54,924 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:54,924 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:54,924 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:55,246 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,246 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:55,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:55,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,246 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:55,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:55,248 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:55,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:55,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:55,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:55,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,252 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:55,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:55,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:55,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:55,625 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:55,625 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:55,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:55,625 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:55,625 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:55,625 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-08 00:56:55,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:55,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:55,625 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,627 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,627 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:55,627 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:55,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-08 00:56:55,627 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:55,627 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,627 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,627 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:55,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:55,727 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:55,727 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:55,727 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:55,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:55,731 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:55,731 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:55,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:56:55,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-02-08 00:56:55,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,734 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-02-08 00:56:55,734 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:55,735 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-02-08 00:56:55,735 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-02-08 00:56:55,735 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:55,735 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:56,014 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:56,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:56,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:56,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:56,015 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:56,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:56:56,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:56,015 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:56,016 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-02-08 00:56:56,016 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:56,016 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-02-08 00:56:56,016 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:56:56,016 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-02-08 00:56:56,017 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:56,017 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 00:56:56,017 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 00:56:56,017 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. started... 2023-02-08 00:56:56,017 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. started... 2023-02-08 00:56:56,017 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 00:56:56,017 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 3b0ead07198c1a0973ebc9c72e876b7b: 2023-02-08 00:56:56,017 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:56,017 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:56:56,017 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 00:56:56,017 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. started... 2023-02-08 00:56:56,017 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing cafd9b0cf7097e09cf9b7e7ea6e8da0a 2/2 column families, dataSize=90 B heapSize=752 B 2023-02-08 00:56:56,017 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:56:56,018 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:56:56,017 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for b50089805dc4677867e1dbc0df92d93d: 2023-02-08 00:56:56,018 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:56:56,018 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 00:56:56,018 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:56:56,447 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302086858fcbff6054bcfa8030c90921be3c4 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302086858fcbff6054bcfa8030c90921be3c4 2023-02-08 00:56:56,853 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/.tmp/family1/42ccfd3ebc8c44d4b2ab385879877162 2023-02-08 00:56:56,864 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/.tmp/family1/42ccfd3ebc8c44d4b2ab385879877162 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/42ccfd3ebc8c44d4b2ab385879877162 2023-02-08 00:56:56,872 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/42ccfd3ebc8c44d4b2ab385879877162, entries=2, sequenceid=9, filesize=5.0 K 2023-02-08 00:56:56,873 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for cafd9b0cf7097e09cf9b7e7ea6e8da0a in 856ms, sequenceid=9, compaction requested=false 2023-02-08 00:56:56,874 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for cafd9b0cf7097e09cf9b7e7ea6e8da0a: 2023-02-08 00:56:56,874 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 00:56:56,874 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:56:56,874 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:56:56,875 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:56,875 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-02-08 00:56:56,875 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-02-08 00:56:57,276 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:57,276 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:57,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:57,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:57,278 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,278 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:56:57,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:57,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:57,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:57,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-02-08 00:56:57,282 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e7faa90[Count = 0] remaining members to acquire global barrier 2023-02-08 00:56:57,282 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-02-08 00:56:57,283 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,354 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,354 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-02-08 00:56:57,354 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-02-08 00:56:57,354 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:56:57,354 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:57,354 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:56:57,419 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:57,419 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-02-08 00:56:57,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:57,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:57,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:57,419 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:57,419 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-02-08 00:56:57,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:57,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:57,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:57,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:57,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:57,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:56:57,427 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-02-08 00:56:57,427 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-02-08 00:56:57,427 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:56:57,427 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:56:57,428 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,428 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:56:57,712 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,712 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,712 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:57,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:56:57,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:56:57,714 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:57,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:57,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:57,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:56:57,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:56:57,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,716 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:57,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:57,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:56:57,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:57,743 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:56:57,743 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:57,743 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-02-08 00:56:57,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:56:57,743 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:56:57,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:56:57,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:56:57,744 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-02-08 00:56:57,743 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:56:57,744 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:56:57,743 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:56:57,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:56:57,745 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-02-08 00:56:57,745 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:56:57,745 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,745 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,745 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,845 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:56:57,845 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:57,846 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:57,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:56:57,860 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-02-08 00:56:57,862 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-08 00:56:57,863 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-08 00:56:57,864 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818417864 2023-02-08 00:56:57,864 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:56:57,865 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 00:56:57,865 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-02-08 00:56:57,865 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-08 00:56:57,865 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x71c2513e to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:56:58,123 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d6d1471, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:56:58,124 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230208 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-08 00:56:58,965 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302083afc48dc22664d4ea712f87d2a5a98de to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302083afc48dc22664d4ea712f87d2a5a98de 2023-02-08 00:56:58,967 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-08 00:56:58,979 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:56:58,980 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:54840, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:56:58,986 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:58,986 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:58,987 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:56:58,989 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:56944, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:56:58,999 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230208/family1/75948cd6ef6845809e0000e51d0f69dd first=Optional[k0] last=Optional[k1] 2023-02-08 00:56:59,000 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230208/family1/75948cd6ef6845809e0000e51d0f69dd}] 2023-02-08 00:56:59,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230208/family1/75948cd6ef6845809e0000e51d0f69dd for inclusion in cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1 2023-02-08 00:56:59,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-02-08 00:56:59,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-08 00:56:59,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for cafd9b0cf7097e09cf9b7e7ea6e8da0a: 2023-02-08 00:56:59,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230208/family1/75948cd6ef6845809e0000e51d0f69dd to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testScannerOnBulkLoadRefHFiles__obbksla0qgbucij01u44c8dd8o3f10uq72qhjprooq0h9ufj8v06cv7ut797rn8o/family1/75948cd6ef6845809e0000e51d0f69dd 2023-02-08 00:56:59,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testScannerOnBulkLoadRefHFiles__obbksla0qgbucij01u44c8dd8o3f10uq72qhjprooq0h9ufj8v06cv7ut797rn8o/family1/75948cd6ef6845809e0000e51d0f69dd as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/76bcf3350c6c4920b18aa8d001d05892_SeqId_12_ 2023-02-08 00:56:59,012 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testScannerOnBulkLoadRefHFiles__obbksla0qgbucij01u44c8dd8o3f10uq72qhjprooq0h9ufj8v06cv7ut797rn8o/family1/75948cd6ef6845809e0000e51d0f69dd into cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/76bcf3350c6c4920b18aa8d001d05892_SeqId_12_ - updating store file list. 2023-02-08 00:56:59,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/76bcf3350c6c4920b18aa8d001d05892_SeqId_12_ into cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1 2023-02-08 00:56:59,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testScannerOnBulkLoadRefHFiles__obbksla0qgbucij01u44c8dd8o3f10uq72qhjprooq0h9ufj8v06cv7ut797rn8o/family1/75948cd6ef6845809e0000e51d0f69dd into cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/76bcf3350c6c4920b18aa8d001d05892_SeqId_12_) 2023-02-08 00:56:59,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testScannerOnBulkLoadRefHFiles__obbksla0qgbucij01u44c8dd8o3f10uq72qhjprooq0h9ufj8v06cv7ut797rn8o/family1/75948cd6ef6845809e0000e51d0f69dd 2023-02-08 00:56:59,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 00:56:59,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 00:56:59,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1 is initiating minor compaction (all files) 2023-02-08 00:56:59,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@23b1a4a5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:56:59,018 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1 in testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 00:56:59,018 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/453cd3aefd5b46d8805b43008add1343, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/42ccfd3ebc8c44d4b2ab385879877162, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/76bcf3350c6c4920b18aa8d001d05892_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/.tmp, totalSize=15.1 K 2023-02-08 00:56:59,018 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 453cd3aefd5b46d8805b43008add1343, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817814055 2023-02-08 00:56:59,019 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 42ccfd3ebc8c44d4b2ab385879877162, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817814055 2023-02-08 00:56:59,019 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 76bcf3350c6c4920b18aa8d001d05892_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817814055 2023-02-08 00:56:59,019 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-08 00:56:59,020 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:56:59,021 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023020813d1c96fb9de46e3b9e5a016c891299f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023020813d1c96fb9de46e3b9e5a016c891299f 2023-02-08 00:56:59,022 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302086858fcbff6054bcfa8030c90921be3c4 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c202302086858fcbff6054bcfa8030c90921be3c4 2023-02-08 00:56:59,022 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-02-08 00:56:59,022 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20230208' 2023-02-08 00:56:59,023 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230208 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-02-08 00:56:59,023 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-02-08 00:56:59,023 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:56:59,024 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-02-08 00:56:59,025 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 1.1630 sec 2023-02-08 00:56:59,029 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): cafd9b0cf7097e09cf9b7e7ea6e8da0a#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:56:59,058 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=232 (was 241), OpenFileDescriptor=581 (was 577) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=291 (was 282) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 175), AvailableMemoryMB=3502 (was 3507) 2023-02-08 00:56:59,068 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=232, OpenFileDescriptor=581, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=175, AvailableMemoryMB=3501 2023-02-08 00:56:59,070 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:59,070 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:59,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-08 00:56:59,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-02-08 00:56:59,074 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 00:56:59,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-02-08 00:56:59,074 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:59,074 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:59,075 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 00:56:59,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-08 00:56:59,076 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8 2023-02-08 00:56:59,076 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8 empty. 2023-02-08 00:56:59,077 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8 2023-02-08 00:56:59,077 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-02-08 00:56:59,175 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:59,176 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:59,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-08 00:56:59,377 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:59,377 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:59,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-08 00:56:59,395 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:56:59,486 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-08 00:56:59,489 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => 600f577ac8ccdcebef626e9d4a28aab8, NAME => 'testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:56:59,679 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:56:59,679 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:56:59,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-08 00:56:59,901 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:56:59,902 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1603): Closing 600f577ac8ccdcebef626e9d4a28aab8, disabling compactions & flushes 2023-02-08 00:56:59,902 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:56:59,902 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:56:59,902 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. after waiting 0 ms 2023-02-08 00:56:59,902 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:56:59,902 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:56:59,902 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for 600f577ac8ccdcebef626e9d4a28aab8: Waiting for close lock at 1675817819902Disabling compacts and flushes for region at 1675817819902Disabling writes for close at 1675817819902Writing region close event to WAL at 1675817819902Closed at 1675817819902 2023-02-08 00:56:59,907 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 00:56:59,909 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675817819909"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817819909"}]},"ts":"1675817819909"} 2023-02-08 00:56:59,912 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 00:56:59,913 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 00:56:59,914 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817819914"}]},"ts":"1675817819914"} 2023-02-08 00:56:59,916 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-02-08 00:57:00,181 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:00,182 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:00,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-08 00:57:00,235 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=600f577ac8ccdcebef626e9d4a28aab8, ASSIGN}] 2023-02-08 00:57:00,236 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=600f577ac8ccdcebef626e9d4a28aab8, ASSIGN 2023-02-08 00:57:00,237 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=600f577ac8ccdcebef626e9d4a28aab8, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:57:00,254 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/.tmp/family1/4b735f062b8c45a3b9cb153790a32b55 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/4b735f062b8c45a3b9cb153790a32b55 2023-02-08 00:57:00,259 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1 of cafd9b0cf7097e09cf9b7e7ea6e8da0a into 4b735f062b8c45a3b9cb153790a32b55(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:57:00,259 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for cafd9b0cf7097e09cf9b7e7ea6e8da0a: 2023-02-08 00:57:00,259 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1675817819017; duration=1sec 2023-02-08 00:57:00,259 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:57:00,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/453cd3aefd5b46d8805b43008add1343, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/42ccfd3ebc8c44d4b2ab385879877162, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/76bcf3350c6c4920b18aa8d001d05892_SeqId_12_] to archive 2023-02-08 00:57:00,325 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:57:00,327 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/453cd3aefd5b46d8805b43008add1343 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/453cd3aefd5b46d8805b43008add1343 2023-02-08 00:57:00,328 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/42ccfd3ebc8c44d4b2ab385879877162 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/42ccfd3ebc8c44d4b2ab385879877162 2023-02-08 00:57:00,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/76bcf3350c6c4920b18aa8d001d05892_SeqId_12_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/family1/76bcf3350c6c4920b18aa8d001d05892_SeqId_12_ 2023-02-08 00:57:00,388 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=600f577ac8ccdcebef626e9d4a28aab8, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:00,388 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675817820388"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817820388"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817820388"}]},"ts":"1675817820388"} 2023-02-08 00:57:00,391 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 600f577ac8ccdcebef626e9d4a28aab8, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:57:00,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:00,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 600f577ac8ccdcebef626e9d4a28aab8, NAME => 'testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:57:00,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 600f577ac8ccdcebef626e9d4a28aab8 2023-02-08 00:57:00,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:57:00,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 600f577ac8ccdcebef626e9d4a28aab8 2023-02-08 00:57:00,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 600f577ac8ccdcebef626e9d4a28aab8 2023-02-08 00:57:00,554 INFO [StoreOpener-600f577ac8ccdcebef626e9d4a28aab8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 600f577ac8ccdcebef626e9d4a28aab8 2023-02-08 00:57:00,558 DEBUG [StoreOpener-600f577ac8ccdcebef626e9d4a28aab8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1 2023-02-08 00:57:00,558 DEBUG [StoreOpener-600f577ac8ccdcebef626e9d4a28aab8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1 2023-02-08 00:57:00,559 INFO [StoreOpener-600f577ac8ccdcebef626e9d4a28aab8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 600f577ac8ccdcebef626e9d4a28aab8 columnFamilyName family1 2023-02-08 00:57:00,562 INFO [StoreOpener-600f577ac8ccdcebef626e9d4a28aab8-1] regionserver.HStore(310): Store=600f577ac8ccdcebef626e9d4a28aab8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:57:00,563 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8 2023-02-08 00:57:00,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8 2023-02-08 00:57:00,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 600f577ac8ccdcebef626e9d4a28aab8 2023-02-08 00:57:00,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:57:00,570 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 600f577ac8ccdcebef626e9d4a28aab8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68714300, jitterRate=0.023922860622406006}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:57:00,570 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 600f577ac8ccdcebef626e9d4a28aab8: Running coprocessor pre-open hook at 1675817820551Writing region info on filesystem at 1675817820551Initializing all the Stores at 1675817820553 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675817820553Cleaning up temporary data from old regions at 1675817820564 (+11 ms)Cleaning up detritus from prior splits at 1675817820565 (+1 ms)Running coprocessor post-open hooks at 1675817820570 (+5 ms)Region opened successfully at 1675817820570 2023-02-08 00:57:00,571 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8., pid=37, masterSystemTime=1675817820543 2023-02-08 00:57:00,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:00,573 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:00,574 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=600f577ac8ccdcebef626e9d4a28aab8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:00,574 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1675817820574"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817820574"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817820574"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817820574"}]},"ts":"1675817820574"} 2023-02-08 00:57:00,578 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-02-08 00:57:00,578 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 600f577ac8ccdcebef626e9d4a28aab8, server=jenkins-hbase12.apache.org,36907,1675817727419 in 185 msec 2023-02-08 00:57:00,580 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=36, resume processing ppid=35 2023-02-08 00:57:00,580 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=600f577ac8ccdcebef626e9d4a28aab8, ASSIGN in 344 msec 2023-02-08 00:57:00,581 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 00:57:00,581 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817820581"}]},"ts":"1675817820581"} 2023-02-08 00:57:00,582 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-02-08 00:57:00,604 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 00:57:00,607 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.5340 sec 2023-02-08 00:57:01,184 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:01,185 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:01,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=35 2023-02-08 00:57:01,187 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-02-08 00:57:01,210 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:01,210 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:01,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:01,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,213 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:01,213 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:01,213 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:57:01,213 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:57:01,214 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,214 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,540 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:01,540 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:01,540 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:01,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:01,541 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:01,541 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:01,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:01,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,544 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,544 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,545 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:57:01,545 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:01,546 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:57:01,546 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:01,546 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:01,546 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:01,547 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. started... 2023-02-08 00:57:01,547 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 600f577ac8ccdcebef626e9d4a28aab8 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-08 00:57:01,571 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113034bc1347fc8c416988df5a4894a46b9b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113034bc1347fc8c416988df5a4894a46b9b 2023-02-08 00:57:01,575 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/d775375ac57245b99894d48205092d0d 2023-02-08 00:57:01,579 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/d775375ac57245b99894d48205092d0d as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d775375ac57245b99894d48205092d0d 2023-02-08 00:57:01,584 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d775375ac57245b99894d48205092d0d, entries=1000, sequenceid=5, filesize=165.1 K 2023-02-08 00:57:01,585 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 600f577ac8ccdcebef626e9d4a28aab8 in 38ms, sequenceid=5, compaction requested=false 2023-02-08 00:57:01,585 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:01,586 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 600f577ac8ccdcebef626e9d4a28aab8: 2023-02-08 00:57:01,586 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:01,586 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:01,586 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:01,586 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:01,586 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:57:01,586 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:57:01,742 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:01,742 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:01,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:01,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:01,743 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,743 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:01,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:01,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:01,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:01,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:01,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:57:01,746 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c333523[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:01,746 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:57:01,746 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,824 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,824 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:01,824 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:57:01,824 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:01,824 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:01,824 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:57:01,824 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:02,149 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:02,149 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:57:02,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:02,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:02,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:02,149 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:02,150 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:57:02,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:02,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:02,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:02,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:02,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:02,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:02,154 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:57:02,154 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:57:02,154 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:02,154 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:02,154 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,154 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:02,181 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,181 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:02,181 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,181 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:02,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:02,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:02,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:02,182 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:02,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:02,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:02,184 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:02,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:02,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:02,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:02,202 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:02,202 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,202 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,203 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:02,203 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:02,202 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:02,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:02,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:02,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:02,203 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,204 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:57:02,204 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:02,203 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:02,204 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,204 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:02,204 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:02,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:02,205 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:02,305 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:02,305 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:02,306 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:02,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:02,317 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:02,317 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:02,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:02,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:02,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,320 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:02,320 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:02,321 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:57:02,321 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:57:02,322 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,322 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,507 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:02,507 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:02,507 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:02,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:02,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,507 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:02,507 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:02,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:02,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,508 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,509 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:57:02,509 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:02,509 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:57:02,509 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:02,509 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:57:02,510 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:02,510 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:02,510 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:02,510 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. started... 2023-02-08 00:57:02,510 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 600f577ac8ccdcebef626e9d4a28aab8 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-08 00:57:02,526 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128bf28479d7daf47379b4963c8f37f0012 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128bf28479d7daf47379b4963c8f37f0012 2023-02-08 00:57:02,934 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/cd3c09e3fc8b490dac9d029a73d5d2c3 2023-02-08 00:57:02,939 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/cd3c09e3fc8b490dac9d029a73d5d2c3 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/cd3c09e3fc8b490dac9d029a73d5d2c3 2023-02-08 00:57:02,944 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/cd3c09e3fc8b490dac9d029a73d5d2c3, entries=1, sequenceid=9, filesize=5.0 K 2023-02-08 00:57:02,944 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 600f577ac8ccdcebef626e9d4a28aab8 in 434ms, sequenceid=9, compaction requested=false 2023-02-08 00:57:02,944 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 600f577ac8ccdcebef626e9d4a28aab8: 2023-02-08 00:57:02,944 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:02,945 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:02,945 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:02,945 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:02,945 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:57:02,945 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:57:03,265 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,265 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:03,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:03,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:03,266 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:03,266 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:03,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:03,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:03,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:03,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:03,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:57:03,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5688dd06[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:03,268 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:57:03,268 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,348 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,348 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:03,348 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:57:03,348 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:57:03,348 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:03,348 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:03,392 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:57:03,392 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:03,392 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:03,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:03,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:03,392 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:57:03,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:03,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:03,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:03,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:03,399 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:57:03,400 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:57:03,400 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:03,400 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:03,400 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,400 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:03,687 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,687 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,687 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:03,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:03,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:03,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:03,688 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:03,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:03,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:03,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:03,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,690 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:03,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:03,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:03,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:03,964 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:03,964 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,964 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,964 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:03,964 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:03,964 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:03,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:03,964 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:03,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:03,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:03,965 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:03,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:57:03,965 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,966 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:03,966 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:03,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:03,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:03,966 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:03,966 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:04,067 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:04,067 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:04,067 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:04,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:04,074 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:04,075 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:04,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:04,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:04,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:04,079 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:04,079 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:04,080 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:57:04,080 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:57:04,080 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:04,080 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:04,132 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:04,132 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:04,132 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:04,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:04,133 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:04,133 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:04,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:04,134 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:04,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:04,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:04,135 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:04,135 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:57:04,136 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:04,136 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:57:04,136 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:04,137 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:57:04,137 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:04,138 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:04,138 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:04,138 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. started... 2023-02-08 00:57:04,138 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 600f577ac8ccdcebef626e9d4a28aab8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:04,559 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201e8a64e402ea645578c1b0b206bc3ebc7 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201e8a64e402ea645578c1b0b206bc3ebc7 2023-02-08 00:57:04,969 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/273f3434317e488d871d920a98369783 2023-02-08 00:57:04,980 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/273f3434317e488d871d920a98369783 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/273f3434317e488d871d920a98369783 2023-02-08 00:57:04,988 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/273f3434317e488d871d920a98369783, entries=1, sequenceid=13, filesize=4.9 K 2023-02-08 00:57:04,989 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 600f577ac8ccdcebef626e9d4a28aab8 in 851ms, sequenceid=13, compaction requested=true 2023-02-08 00:57:04,989 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 600f577ac8ccdcebef626e9d4a28aab8: 2023-02-08 00:57:04,989 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:04,989 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:04,990 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:04,990 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:04,990 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:57:04,990 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:57:05,097 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,097 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:05,098 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,098 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:05,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:05,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:05,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:05,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:57:05,102 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:57:05,102 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1eb03607[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:05,122 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,122 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:57:05,122 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:57:05,122 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:05,122 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,122 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:05,132 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:57:05,132 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,132 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,132 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:57:05,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:05,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:05,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:05,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:05,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:57:05,137 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:57:05,137 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:05,137 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:05,137 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,137 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:05,428 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,428 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:05,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,428 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:05,428 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:05,428 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:05,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:05,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,430 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:05,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,529 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,529 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:05,529 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:05,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:05,530 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,530 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:05,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:05,530 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:05,530 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:05,531 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:05,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:57:05,530 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,533 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,533 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:05,532 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:05,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:05,533 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,634 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:05,634 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:05,634 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:05,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:05,644 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:05,644 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:05,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:05,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:05,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,648 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:05,648 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:05,649 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:57:05,649 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:57:05,650 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,650 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,970 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:05,971 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:05,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:05,971 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:05,972 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:05,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,972 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:05,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,973 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,973 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:57:05,973 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:05,973 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:57:05,974 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:05,974 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:57:05,975 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:05,975 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:05,975 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:05,975 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. started... 2023-02-08 00:57:05,975 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 600f577ac8ccdcebef626e9d4a28aab8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:06,054 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:57:06,400 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051737c568043f46bcae5fd397843da91e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051737c568043f46bcae5fd397843da91e 2023-02-08 00:57:06,809 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/7e817eac850d483f81d3baa39342c97d 2023-02-08 00:57:06,814 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/7e817eac850d483f81d3baa39342c97d as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/7e817eac850d483f81d3baa39342c97d 2023-02-08 00:57:06,818 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/7e817eac850d483f81d3baa39342c97d, entries=1, sequenceid=17, filesize=4.9 K 2023-02-08 00:57:06,819 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 600f577ac8ccdcebef626e9d4a28aab8 in 844ms, sequenceid=17, compaction requested=true 2023-02-08 00:57:06,819 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 600f577ac8ccdcebef626e9d4a28aab8: 2023-02-08 00:57:06,819 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:06,819 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:06,819 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:06,819 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:06,819 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:57:06,819 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:57:06,927 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:06,927 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:06,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:06,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:06,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:06,928 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:06,928 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:06,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:06,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:06,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:06,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:06,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:06,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:57:06,930 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d68246b[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:06,930 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:57:06,930 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:06,949 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:06,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:06,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:06,950 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:57:06,950 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:57:06,950 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:06,950 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:06,950 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:06,970 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:57:06,971 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:06,971 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:57:06,970 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:06,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:06,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:06,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:06,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:06,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:06,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:06,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:06,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:06,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:06,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:06,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:06,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:57:06,974 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:57:06,974 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:06,974 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:06,974 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:06,974 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:07,258 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,258 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:07,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,258 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:07,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:07,259 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:07,259 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:07,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:07,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:07,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:07,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,260 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:07,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:07,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:07,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:07,279 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:07,279 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:07,279 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,280 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:57:07,280 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,280 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:07,280 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,280 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:07,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:07,280 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:07,279 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:07,279 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:07,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:07,280 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,281 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:07,281 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:07,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:07,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:07,381 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:07,381 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:07,382 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:07,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:07,389 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:07,389 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:07,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:07,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:07,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,392 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:07,393 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:07,393 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:57:07,393 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:57:07,394 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,394 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,687 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:07,687 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:07,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:07,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:07,688 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:07,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,688 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:07,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:07,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,688 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,689 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:57:07,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:07,689 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:57:07,689 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:07,689 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:57:07,689 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:07,689 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:07,689 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:07,690 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. started... 2023-02-08 00:57:07,690 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 600f577ac8ccdcebef626e9d4a28aab8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:08,106 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512280c53fdefa9ed43a4806ae124a2440014 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512280c53fdefa9ed43a4806ae124a2440014 2023-02-08 00:57:08,113 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/0b1d8cfa978341f1a552cb17c6f07480 2023-02-08 00:57:08,119 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/0b1d8cfa978341f1a552cb17c6f07480 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/0b1d8cfa978341f1a552cb17c6f07480 2023-02-08 00:57:08,124 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/0b1d8cfa978341f1a552cb17c6f07480, entries=1, sequenceid=21, filesize=4.9 K 2023-02-08 00:57:08,124 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 600f577ac8ccdcebef626e9d4a28aab8 in 434ms, sequenceid=21, compaction requested=true 2023-02-08 00:57:08,124 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 600f577ac8ccdcebef626e9d4a28aab8: 2023-02-08 00:57:08,125 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:08,125 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:08,125 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:08,125 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,125 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:57:08,125 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:57:08,381 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,381 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:08,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:08,381 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,381 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:08,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:08,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:08,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:08,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:57:08,383 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48579ec8[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:08,383 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:57:08,383 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,406 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,407 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:57:08,407 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:57:08,407 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,407 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:08,407 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:08,427 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,427 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:57:08,428 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:08,428 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:57:08,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:08,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:08,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:08,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:08,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:08,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:08,433 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:57:08,433 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:57:08,433 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:08,433 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:08,433 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,433 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:08,738 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,738 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:08,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,738 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:08,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:08,739 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:08,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,740 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:08,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,771 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,771 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:08,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:08,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:08,771 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:08,771 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,772 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:57:08,771 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:08,771 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:08,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:08,772 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:08,772 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:08,773 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:08,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:08,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:08,873 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:08,873 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:08,874 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:08,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:08,882 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:08,882 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:08,883 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:08,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:08,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,886 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:08,886 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:08,887 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:57:08,887 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:57:08,888 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:08,888 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:09,153 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:09,154 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:09,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:09,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:09,155 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:09,155 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:09,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:09,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:09,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:09,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:09,158 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:09,159 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:57:09,159 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:09,159 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:57:09,159 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:09,160 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:57:09,160 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:09,160 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:09,160 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:09,160 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. started... 2023-02-08 00:57:09,160 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 600f577ac8ccdcebef626e9d4a28aab8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:09,575 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123101c464f2538c47019df30ae6b65e32b8 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123101c464f2538c47019df30ae6b65e32b8 2023-02-08 00:57:09,982 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/5f34a26cff694ddfb202c624679dce42 2023-02-08 00:57:09,989 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/5f34a26cff694ddfb202c624679dce42 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/5f34a26cff694ddfb202c624679dce42 2023-02-08 00:57:09,995 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/5f34a26cff694ddfb202c624679dce42, entries=1, sequenceid=25, filesize=4.9 K 2023-02-08 00:57:09,996 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 600f577ac8ccdcebef626e9d4a28aab8 in 836ms, sequenceid=25, compaction requested=true 2023-02-08 00:57:09,996 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 600f577ac8ccdcebef626e9d4a28aab8: 2023-02-08 00:57:09,997 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:09,997 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:09,997 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:09,997 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:09,997 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:57:09,997 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:57:10,253 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:10,253 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:10,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:10,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:10,254 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,254 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:10,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:10,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:10,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:10,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:10,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:57:10,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58270a29[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:10,256 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:57:10,257 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,290 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,290 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,290 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:57:10,290 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:57:10,290 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:10,290 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:10,290 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:10,300 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:57:10,300 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:10,300 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:57:10,300 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:10,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:10,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:10,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:10,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:10,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:10,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:10,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:10,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:10,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:10,305 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:57:10,305 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:57:10,306 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:10,306 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:10,306 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,306 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:10,567 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,567 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:10,567 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:10,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,569 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:10,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:10,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:10,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:10,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:10,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,573 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:10,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:10,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:10,616 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:10,616 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:10,616 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:10,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:10,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:10,616 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:10,616 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:10,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:10,616 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,617 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,617 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:10,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:10,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:10,617 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:57:10,617 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:10,617 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,617 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:10,617 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,617 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,717 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:10,718 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:10,718 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:10,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:10,727 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:10,727 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:10,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:10,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:10,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,731 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:10,731 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:10,732 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:57:10,732 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:57:10,733 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:10,733 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:11,027 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:11,027 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:11,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:11,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:11,028 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:11,029 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:11,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:11,030 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:11,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:11,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:11,031 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:11,032 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:57:11,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:11,032 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:57:11,033 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:11,035 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:57:11,035 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:11,035 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:11,035 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:11,035 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. started... 2023-02-08 00:57:11,035 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 600f577ac8ccdcebef626e9d4a28aab8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:11,450 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010164dcb015c2564b70a6379422b998e4a4 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010164dcb015c2564b70a6379422b998e4a4 2023-02-08 00:57:11,860 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/6782482f6d4842f9b6e7976d7454dd5d 2023-02-08 00:57:11,865 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/6782482f6d4842f9b6e7976d7454dd5d as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/6782482f6d4842f9b6e7976d7454dd5d 2023-02-08 00:57:11,869 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/6782482f6d4842f9b6e7976d7454dd5d, entries=1, sequenceid=29, filesize=4.9 K 2023-02-08 00:57:11,870 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 600f577ac8ccdcebef626e9d4a28aab8 in 835ms, sequenceid=29, compaction requested=true 2023-02-08 00:57:11,870 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 600f577ac8ccdcebef626e9d4a28aab8: 2023-02-08 00:57:11,870 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:11,870 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:11,870 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:11,870 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:11,870 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:57:11,870 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:57:12,279 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,279 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:12,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:12,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:12,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:12,280 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,280 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:12,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:12,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:12,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:12,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:12,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:57:12,281 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47381f24[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:12,281 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:57:12,282 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,332 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,332 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:57:12,332 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:57:12,332 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:12,332 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:12,332 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:12,468 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:12,468 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:57:12,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:12,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:12,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:12,468 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:12,469 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:57:12,469 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:12,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:12,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:12,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:12,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:12,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:12,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:57:12,471 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:57:12,471 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:12,471 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:12,471 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,471 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:12,533 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,533 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:12,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:12,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,533 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:12,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:12,534 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:12,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:12,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:12,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:12,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,535 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:12,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:12,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:12,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:12,650 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:12,650 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:12,650 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:12,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:57:12,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:12,651 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,651 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:12,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:12,651 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:12,653 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:12,653 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:12,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:12,651 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:12,654 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,654 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,654 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:12,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:12,754 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:12,754 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:12,754 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:12,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:12,764 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:12,764 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:12,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:12,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:12,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,768 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:12,768 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:12,768 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:57:12,768 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:57:12,768 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:12,768 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:13,089 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:13,089 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:13,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:13,089 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:13,090 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:13,090 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:13,090 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:13,091 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:57:13,091 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:13,091 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:57:13,091 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:13,091 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:57:13,091 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:13,091 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:13,091 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:13,091 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. started... 2023-02-08 00:57:13,091 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 600f577ac8ccdcebef626e9d4a28aab8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:13,515 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601038fc5a75c850344399d68cd5e81a1882b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601038fc5a75c850344399d68cd5e81a1882b 2023-02-08 00:57:13,922 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/4105bd59263646a68f81c91c83e60bbc 2023-02-08 00:57:13,927 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/4105bd59263646a68f81c91c83e60bbc as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/4105bd59263646a68f81c91c83e60bbc 2023-02-08 00:57:13,931 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/4105bd59263646a68f81c91c83e60bbc, entries=1, sequenceid=33, filesize=4.9 K 2023-02-08 00:57:13,932 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 600f577ac8ccdcebef626e9d4a28aab8 in 841ms, sequenceid=33, compaction requested=true 2023-02-08 00:57:13,932 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 600f577ac8ccdcebef626e9d4a28aab8: 2023-02-08 00:57:13,932 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:13,932 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:13,932 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:13,932 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:13,932 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:57:13,932 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:57:14,247 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,247 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:14,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:14,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:14,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:14,248 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,248 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:14,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:14,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:14,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:14,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:14,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:57:14,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b5f30d4[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:14,252 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:57:14,252 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,313 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,314 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:57:14,314 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:57:14,314 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:14,314 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:14,314 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:14,339 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:57:14,339 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:14,339 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:14,339 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:57:14,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:14,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:14,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:14,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:14,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:14,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:14,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:14,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:14,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:14,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:57:14,344 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:57:14,344 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:14,344 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:14,344 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,344 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:14,360 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,360 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,360 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:14,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:14,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:14,361 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:14,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:14,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:14,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:14,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:14,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,363 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:14,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:14,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:14,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:14,689 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:14,690 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,690 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,690 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:14,689 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:14,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:14,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:14,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:14,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:14,690 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:14,690 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:14,690 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:14,690 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:57:14,690 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:14,690 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,691 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:14,691 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:14,791 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:14,791 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:14,791 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:14,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:14,798 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:14,799 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:14,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:14,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:14,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,801 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:14,801 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:14,801 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:57:14,801 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:57:14,801 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:14,801 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,153 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:15,153 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:15,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:15,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:15,154 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:15,154 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:15,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:15,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,156 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,157 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:57:15,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,157 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:57:15,157 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:15,157 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:57:15,158 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:15,158 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:15,158 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:15,158 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. started... 2023-02-08 00:57:15,158 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 600f577ac8ccdcebef626e9d4a28aab8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:15,175 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090721d702a73b7f48df94e68512c36cda49 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015090721d702a73b7f48df94e68512c36cda49 2023-02-08 00:57:15,584 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/d5b1532a78a144668d7d52f4baccf787 2023-02-08 00:57:15,594 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/d5b1532a78a144668d7d52f4baccf787 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d5b1532a78a144668d7d52f4baccf787 2023-02-08 00:57:15,602 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d5b1532a78a144668d7d52f4baccf787, entries=1, sequenceid=37, filesize=4.9 K 2023-02-08 00:57:15,602 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 600f577ac8ccdcebef626e9d4a28aab8 in 444ms, sequenceid=37, compaction requested=true 2023-02-08 00:57:15,603 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 600f577ac8ccdcebef626e9d4a28aab8: 2023-02-08 00:57:15,603 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:15,603 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:15,603 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:15,603 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:15,603 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:57:15,603 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:57:15,885 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:15,885 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:15,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:15,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:15,886 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,886 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:15,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:15,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:15,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:15,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:15,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:57:15,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f8a52a9[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:15,890 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:57:15,890 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,931 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,932 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:57:15,932 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:57:15,932 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:15,932 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:15,932 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:15,942 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:57:15,942 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:15,942 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:15,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:15,942 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:57:15,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:15,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:15,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:15,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:15,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:15,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:15,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:57:15,946 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:57:15,946 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:15,946 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:15,946 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:15,946 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:16,307 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,307 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:16,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:16,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,308 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:16,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:16,310 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:16,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:16,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:16,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:16,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:16,313 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:16,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:16,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:16,331 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:16,331 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:16,331 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:16,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:16,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:16,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:57:16,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:16,332 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:16,332 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:16,333 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:16,331 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,331 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:16,333 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:16,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:16,333 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:16,333 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,333 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,433 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:16,433 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:16,433 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:16,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:16,445 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:16,445 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:16,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:16,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:16,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,448 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:16,449 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:16,449 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-02-08 00:57:16,449 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-02-08 00:57:16,450 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,450 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,718 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:16,718 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:16,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:16,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:16,718 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:16,719 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:16,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,719 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:16,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,720 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,720 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-02-08 00:57:16,720 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:16,722 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-02-08 00:57:16,722 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:16,722 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-02-08 00:57:16,722 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:16,722 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:16,722 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:16,722 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. started... 2023-02-08 00:57:16,723 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 600f577ac8ccdcebef626e9d4a28aab8 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:17,144 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511203a1cf0da0ccf4510ac7a2e6343835157 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511203a1cf0da0ccf4510ac7a2e6343835157 2023-02-08 00:57:17,551 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/d5241402cc6f4c64975952a9aee1727c 2023-02-08 00:57:17,562 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/d5241402cc6f4c64975952a9aee1727c as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d5241402cc6f4c64975952a9aee1727c 2023-02-08 00:57:17,567 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d5241402cc6f4c64975952a9aee1727c, entries=1, sequenceid=41, filesize=4.9 K 2023-02-08 00:57:17,568 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 600f577ac8ccdcebef626e9d4a28aab8 in 845ms, sequenceid=41, compaction requested=true 2023-02-08 00:57:17,568 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 600f577ac8ccdcebef626e9d4a28aab8: 2023-02-08 00:57:17,568 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:17,568 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:17,568 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:17,568 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:17,568 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-02-08 00:57:17,568 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-02-08 00:57:17,874 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:17,874 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:17,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:17,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:17,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:17,876 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:17,876 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:17,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:17,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:17,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:17,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:17,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:17,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-02-08 00:57:17,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f1c7533[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:17,883 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-02-08 00:57:17,883 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,009 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,010 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-02-08 00:57:18,010 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-02-08 00:57:18,010 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:18,010 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:18,010 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:18,034 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-02-08 00:57:18,034 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:18,034 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-02-08 00:57:18,034 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:18,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:18,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:18,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:18,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:18,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:18,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:18,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:18,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:18,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:18,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:57:18,044 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-02-08 00:57:18,044 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:18,044 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:18,044 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,044 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:18,065 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,065 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:18,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:18,065 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:18,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:18,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:18,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:18,066 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:18,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:18,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,068 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:18,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:18,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:18,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:18,486 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:18,486 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:18,486 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:18,486 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,486 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:18,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:18,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-02-08 00:57:18,487 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:18,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:18,486 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-02-08 00:57:18,488 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:18,488 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:18,488 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,488 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:18,488 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,488 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,488 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:18,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:18,588 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:18,588 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:18,588 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:18,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:18,591 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-02-08 00:57:18,593 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 00:57:18,595 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 00:57:18,596 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818438596 2023-02-08 00:57:18,596 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:57:18,600 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 00:57:18,602 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-02-08 00:57:18,602 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 00:57:18,603 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x77aa3f47 to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:57:18,618 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:57:18,618 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71c2513e to 127.0.0.1:49726 2023-02-08 00:57:18,618 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:57:18,619 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:57:18,619 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2eeacc59 to 127.0.0.1:49726 2023-02-08 00:57:18,619 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:57:18,619 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:57:18,619 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b5e4bbb to 127.0.0.1:49726 2023-02-08 00:57:18,619 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:57:18,837 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5cf266b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:57:18,837 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:57:19,697 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103fa218485d7da4b228c9997fe91b83d5e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103fa218485d7da4b228c9997fe91b83d5e 2023-02-08 00:57:19,698 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 00:57:19,710 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:57:19,711 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:58268, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:57:19,717 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:19,717 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:19,717 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:57:19,718 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:55892, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:57:19,726 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b6e2952b737f4f838487d386014ca4ff first=Optional[r3] last=Optional[r6] 2023-02-08 00:57:19,727 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b6e2952b737f4f838487d386014ca4ff}] 2023-02-08 00:57:19,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b6e2952b737f4f838487d386014ca4ff for inclusion in 600f577ac8ccdcebef626e9d4a28aab8/family1 2023-02-08 00:57:19,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-08 00:57:19,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:57:19,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 600f577ac8ccdcebef626e9d4a28aab8: 2023-02-08 00:57:19,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/b6e2952b737f4f838487d386014ca4ff to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c3jaqdsn0mk4e30jvj5p3hid328c9ghm10nr8crpc4j3dopvf0j5fmktgu0vvr00/family1/b6e2952b737f4f838487d386014ca4ff 2023-02-08 00:57:19,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c3jaqdsn0mk4e30jvj5p3hid328c9ghm10nr8crpc4j3dopvf0j5fmktgu0vvr00/family1/b6e2952b737f4f838487d386014ca4ff as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/a4fc3d32a53e4296b0a2efd6c6a370cc_SeqId_44_ 2023-02-08 00:57:19,738 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c3jaqdsn0mk4e30jvj5p3hid328c9ghm10nr8crpc4j3dopvf0j5fmktgu0vvr00/family1/b6e2952b737f4f838487d386014ca4ff into 600f577ac8ccdcebef626e9d4a28aab8/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/a4fc3d32a53e4296b0a2efd6c6a370cc_SeqId_44_ - updating store file list. 2023-02-08 00:57:19,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/a4fc3d32a53e4296b0a2efd6c6a370cc_SeqId_44_ into 600f577ac8ccdcebef626e9d4a28aab8/family1 2023-02-08 00:57:19,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c3jaqdsn0mk4e30jvj5p3hid328c9ghm10nr8crpc4j3dopvf0j5fmktgu0vvr00/family1/b6e2952b737f4f838487d386014ca4ff into 600f577ac8ccdcebef626e9d4a28aab8/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/a4fc3d32a53e4296b0a2efd6c6a370cc_SeqId_44_) 2023-02-08 00:57:19,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyPolicy__c3jaqdsn0mk4e30jvj5p3hid328c9ghm10nr8crpc4j3dopvf0j5fmktgu0vvr00/family1/b6e2952b737f4f838487d386014ca4ff 2023-02-08 00:57:19,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-08 00:57:19,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-08 00:57:19,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 600f577ac8ccdcebef626e9d4a28aab8/family1 is initiating minor compaction 2023-02-08 00:57:19,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@424fe8e4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:57:19,745 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 600f577ac8ccdcebef626e9d4a28aab8/family1 in testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:19,745 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/cd3c09e3fc8b490dac9d029a73d5d2c3, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/273f3434317e488d871d920a98369783, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/7e817eac850d483f81d3baa39342c97d, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/0b1d8cfa978341f1a552cb17c6f07480, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/5f34a26cff694ddfb202c624679dce42, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/6782482f6d4842f9b6e7976d7454dd5d, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/4105bd59263646a68f81c91c83e60bbc, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d5b1532a78a144668d7d52f4baccf787, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d5241402cc6f4c64975952a9aee1727c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/a4fc3d32a53e4296b0a2efd6c6a370cc_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp, totalSize=50.0 K 2023-02-08 00:57:19,746 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting cd3c09e3fc8b490dac9d029a73d5d2c3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 00:57:19,746 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 273f3434317e488d871d920a98369783, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 00:57:19,746 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 7e817eac850d483f81d3baa39342c97d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-08 00:57:19,746 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 0b1d8cfa978341f1a552cb17c6f07480, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-08 00:57:19,746 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 5f34a26cff694ddfb202c624679dce42, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-08 00:57:19,746 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 6782482f6d4842f9b6e7976d7454dd5d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-08 00:57:19,746 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 4105bd59263646a68f81c91c83e60bbc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-08 00:57:19,746 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting d5b1532a78a144668d7d52f4baccf787, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-08 00:57:19,746 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting d5241402cc6f4c64975952a9aee1727c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-08 00:57:19,746 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting a4fc3d32a53e4296b0a2efd6c6a370cc_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-08 00:57:19,747 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 00:57:19,748 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:57:19,750 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512280c53fdefa9ed43a4806ae124a2440014 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512280c53fdefa9ed43a4806ae124a2440014 2023-02-08 00:57:19,752 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123101c464f2538c47019df30ae6b65e32b8 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123101c464f2538c47019df30ae6b65e32b8 2023-02-08 00:57:19,753 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010164dcb015c2564b70a6379422b998e4a4 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2016010164dcb015c2564b70a6379422b998e4a4 2023-02-08 00:57:19,754 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601038fc5a75c850344399d68cd5e81a1882b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601038fc5a75c850344399d68cd5e81a1882b 2023-02-08 00:57:19,755 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-02-08 00:57:19,755 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-08 00:57:19,755 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:57:19,755 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:57:19,756 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:57:19,756 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:57:19,756 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:57:19,756 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:57:19,756 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:57:19,756 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:57:19,781 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 600f577ac8ccdcebef626e9d4a28aab8#family1#compaction#49 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:57:20,608 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/e5a75d3ef5c240a6a8ffaa33c913020f as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/e5a75d3ef5c240a6a8ffaa33c913020f 2023-02-08 00:57:20,612 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 600f577ac8ccdcebef626e9d4a28aab8/family1 of 600f577ac8ccdcebef626e9d4a28aab8 into e5a75d3ef5c240a6a8ffaa33c913020f(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:57:20,613 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 600f577ac8ccdcebef626e9d4a28aab8: 2023-02-08 00:57:20,613 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1675817839745; duration=0sec 2023-02-08 00:57:20,613 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:57:20,620 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055b5e555062d44090ae4a2f316726c57f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512055b5e555062d44090ae4a2f316726c57f 2023-02-08 00:57:20,626 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 00:57:20,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/cd3c09e3fc8b490dac9d029a73d5d2c3, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/273f3434317e488d871d920a98369783, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/7e817eac850d483f81d3baa39342c97d, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/0b1d8cfa978341f1a552cb17c6f07480, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/5f34a26cff694ddfb202c624679dce42, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/6782482f6d4842f9b6e7976d7454dd5d, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/4105bd59263646a68f81c91c83e60bbc, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d5b1532a78a144668d7d52f4baccf787, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d5241402cc6f4c64975952a9aee1727c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/a4fc3d32a53e4296b0a2efd6c6a370cc_SeqId_44_] to archive 2023-02-08 00:57:20,627 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:57:20,629 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/cd3c09e3fc8b490dac9d029a73d5d2c3 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/cd3c09e3fc8b490dac9d029a73d5d2c3 2023-02-08 00:57:20,631 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/273f3434317e488d871d920a98369783 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/273f3434317e488d871d920a98369783 2023-02-08 00:57:20,632 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/7e817eac850d483f81d3baa39342c97d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/7e817eac850d483f81d3baa39342c97d 2023-02-08 00:57:20,634 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/0b1d8cfa978341f1a552cb17c6f07480 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/0b1d8cfa978341f1a552cb17c6f07480 2023-02-08 00:57:20,635 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/5f34a26cff694ddfb202c624679dce42 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/5f34a26cff694ddfb202c624679dce42 2023-02-08 00:57:20,637 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/6782482f6d4842f9b6e7976d7454dd5d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/6782482f6d4842f9b6e7976d7454dd5d 2023-02-08 00:57:20,638 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/4105bd59263646a68f81c91c83e60bbc to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/4105bd59263646a68f81c91c83e60bbc 2023-02-08 00:57:20,640 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d5b1532a78a144668d7d52f4baccf787 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d5b1532a78a144668d7d52f4baccf787 2023-02-08 00:57:20,641 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d5241402cc6f4c64975952a9aee1727c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d5241402cc6f4c64975952a9aee1727c 2023-02-08 00:57:20,643 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/a4fc3d32a53e4296b0a2efd6c6a370cc_SeqId_44_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/a4fc3d32a53e4296b0a2efd6c6a370cc_SeqId_44_ 2023-02-08 00:57:20,647 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:20,647 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:20,655 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1e569844830149c0ae16814288654345 first=Optional[r00] last=Optional[r2] 2023-02-08 00:57:20,656 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1e569844830149c0ae16814288654345}] 2023-02-08 00:57:20,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1e569844830149c0ae16814288654345 for inclusion in 600f577ac8ccdcebef626e9d4a28aab8/family1 2023-02-08 00:57:20,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-08 00:57:20,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:57:20,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 600f577ac8ccdcebef626e9d4a28aab8: 2023-02-08 00:57:20,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/1e569844830149c0ae16814288654345 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyPolicy__s94cm33qb1gqb50b1g5be8rebptb3i2ktc0ppgasv5d6f55soejbqfhs61oglrq0/family1/1e569844830149c0ae16814288654345 2023-02-08 00:57:20,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyPolicy__s94cm33qb1gqb50b1g5be8rebptb3i2ktc0ppgasv5d6f55soejbqfhs61oglrq0/family1/1e569844830149c0ae16814288654345 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/9162d71f881946e482cb43b8854908dc_SeqId_47_ 2023-02-08 00:57:20,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyPolicy__s94cm33qb1gqb50b1g5be8rebptb3i2ktc0ppgasv5d6f55soejbqfhs61oglrq0/family1/1e569844830149c0ae16814288654345 into 600f577ac8ccdcebef626e9d4a28aab8/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/9162d71f881946e482cb43b8854908dc_SeqId_47_ - updating store file list. 2023-02-08 00:57:20,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/9162d71f881946e482cb43b8854908dc_SeqId_47_ into 600f577ac8ccdcebef626e9d4a28aab8/family1 2023-02-08 00:57:20,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyPolicy__s94cm33qb1gqb50b1g5be8rebptb3i2ktc0ppgasv5d6f55soejbqfhs61oglrq0/family1/1e569844830149c0ae16814288654345 into 600f577ac8ccdcebef626e9d4a28aab8/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/9162d71f881946e482cb43b8854908dc_SeqId_47_) 2023-02-08 00:57:20,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyPolicy__s94cm33qb1gqb50b1g5be8rebptb3i2ktc0ppgasv5d6f55soejbqfhs61oglrq0/family1/1e569844830149c0ae16814288654345 2023-02-08 00:57:20,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 00:57:20,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 00:57:20,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 600f577ac8ccdcebef626e9d4a28aab8/family1 is initiating minor compaction (all files) 2023-02-08 00:57:20,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2be977fd; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-08 00:57:20,675 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 600f577ac8ccdcebef626e9d4a28aab8/family1 in testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 00:57:20,675 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d775375ac57245b99894d48205092d0d, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/e5a75d3ef5c240a6a8ffaa33c913020f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/9162d71f881946e482cb43b8854908dc_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp, totalSize=337.0 K 2023-02-08 00:57:20,676 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting d775375ac57245b99894d48205092d0d, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878836759 2023-02-08 00:57:20,676 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting e5a75d3ef5c240a6a8ffaa33c913020f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621236759 2023-02-08 00:57:20,676 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 9162d71f881946e482cb43b8854908dc_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878836759 2023-02-08 00:57:20,677 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 00:57:20,678 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:57:20,679 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113034bc1347fc8c416988df5a4894a46b9b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015113034bc1347fc8c416988df5a4894a46b9b 2023-02-08 00:57:20,680 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201e8a64e402ea645578c1b0b206bc3ebc7 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201e8a64e402ea645578c1b0b206bc3ebc7 2023-02-08 00:57:20,681 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051737c568043f46bcae5fd397843da91e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512051737c568043f46bcae5fd397843da91e 2023-02-08 00:57:20,681 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-02-08 00:57:20,681 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-08 00:57:20,682 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-02-08 00:57:20,682 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-02-08 00:57:20,682 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:57:20,683 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 00:57:20,684 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 2.0910 sec 2023-02-08 00:57:20,694 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 600f577ac8ccdcebef626e9d4a28aab8#family1#compaction#50 average throughput is 19.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:57:20,780 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=242 (was 232) - Thread LEAK? -, OpenFileDescriptor=579 (was 581), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=316 (was 291) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 175), AvailableMemoryMB=3318 (was 3501) 2023-02-08 00:57:20,790 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=242, OpenFileDescriptor=579, MaxFileDescriptor=60000, SystemLoadAverage=316, ProcessCount=175, AvailableMemoryMB=3317 2023-02-08 00:57:20,791 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:20,791 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:20,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-08 00:57:20,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:20,794 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 00:57:20,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-02-08 00:57:20,795 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:20,795 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:20,795 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 00:57:20,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-08 00:57:20,796 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:20,797 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7 empty. 2023-02-08 00:57:20,797 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:20,797 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-02-08 00:57:20,896 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:20,896 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:20,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-08 00:57:21,098 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:21,098 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:21,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-08 00:57:21,206 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-08 00:57:21,209 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7671): creating {ENCODED => 7b259b18dbc55ddcae38c78ea5c268b7, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:57:21,400 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:21,400 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:21,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-08 00:57:21,619 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:57:21,619 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1603): Closing 7b259b18dbc55ddcae38c78ea5c268b7, disabling compactions & flushes 2023-02-08 00:57:21,620 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:21,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:21,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. after waiting 0 ms 2023-02-08 00:57:21,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:21,620 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:21,620 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1557): Region close journal for 7b259b18dbc55ddcae38c78ea5c268b7: Waiting for close lock at 1675817841619Disabling compacts and flushes for region at 1675817841619Disabling writes for close at 1675817841620 (+1 ms)Writing region close event to WAL at 1675817841620Closed at 1675817841620 2023-02-08 00:57:21,625 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 00:57:21,628 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675817841627"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817841627"}]},"ts":"1675817841627"} 2023-02-08 00:57:21,631 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 00:57:21,632 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 00:57:21,632 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817841632"}]},"ts":"1675817841632"} 2023-02-08 00:57:21,633 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-02-08 00:57:21,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7b259b18dbc55ddcae38c78ea5c268b7, ASSIGN}] 2023-02-08 00:57:21,899 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7b259b18dbc55ddcae38c78ea5c268b7, ASSIGN 2023-02-08 00:57:21,899 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7b259b18dbc55ddcae38c78ea5c268b7, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:57:21,902 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:21,902 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:21,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-08 00:57:21,927 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/.tmp/family1/e358fb25d2964c89961829bfc6875e65 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/e358fb25d2964c89961829bfc6875e65 2023-02-08 00:57:21,933 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 600f577ac8ccdcebef626e9d4a28aab8/family1 of 600f577ac8ccdcebef626e9d4a28aab8 into e358fb25d2964c89961829bfc6875e65(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:57:21,934 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 600f577ac8ccdcebef626e9d4a28aab8: 2023-02-08 00:57:21,934 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1675817840675; duration=1sec 2023-02-08 00:57:21,934 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:57:22,020 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d775375ac57245b99894d48205092d0d, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/e5a75d3ef5c240a6a8ffaa33c913020f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/9162d71f881946e482cb43b8854908dc_SeqId_47_] to archive 2023-02-08 00:57:22,021 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:57:22,024 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d775375ac57245b99894d48205092d0d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/d775375ac57245b99894d48205092d0d 2023-02-08 00:57:22,027 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/e5a75d3ef5c240a6a8ffaa33c913020f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/e5a75d3ef5c240a6a8ffaa33c913020f 2023-02-08 00:57:22,029 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/9162d71f881946e482cb43b8854908dc_SeqId_47_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/family1/9162d71f881946e482cb43b8854908dc_SeqId_47_ 2023-02-08 00:57:22,051 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=7b259b18dbc55ddcae38c78ea5c268b7, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:22,051 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675817842051"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817842051"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817842051"}]},"ts":"1675817842051"} 2023-02-08 00:57:22,054 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure 7b259b18dbc55ddcae38c78ea5c268b7, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:57:22,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:22,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7b259b18dbc55ddcae38c78ea5c268b7, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:57:22,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:22,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:57:22,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:22,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:22,217 INFO [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:22,219 DEBUG [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1 2023-02-08 00:57:22,219 DEBUG [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1 2023-02-08 00:57:22,220 INFO [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b259b18dbc55ddcae38c78ea5c268b7 columnFamilyName family1 2023-02-08 00:57:22,222 INFO [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] regionserver.HStore(310): Store=7b259b18dbc55ddcae38c78ea5c268b7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:57:22,223 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:22,224 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:22,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:22,230 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:57:22,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 7b259b18dbc55ddcae38c78ea5c268b7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62254712, jitterRate=-0.07233250141143799}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:57:22,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 7b259b18dbc55ddcae38c78ea5c268b7: Running coprocessor pre-open hook at 1675817842215Writing region info on filesystem at 1675817842215Initializing all the Stores at 1675817842217 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675817842217Cleaning up temporary data from old regions at 1675817842225 (+8 ms)Cleaning up detritus from prior splits at 1675817842225Running coprocessor post-open hooks at 1675817842231 (+6 ms)Region opened successfully at 1675817842231 2023-02-08 00:57:22,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7., pid=41, masterSystemTime=1675817842206 2023-02-08 00:57:22,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:22,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:22,233 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=7b259b18dbc55ddcae38c78ea5c268b7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:22,233 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675817842233"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817842233"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817842233"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817842233"}]},"ts":"1675817842233"} 2023-02-08 00:57:22,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=41, resume processing ppid=40 2023-02-08 00:57:22,235 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure 7b259b18dbc55ddcae38c78ea5c268b7, server=jenkins-hbase12.apache.org,36907,1675817727419 in 181 msec 2023-02-08 00:57:22,237 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=39 2023-02-08 00:57:22,237 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7b259b18dbc55ddcae38c78ea5c268b7, ASSIGN in 339 msec 2023-02-08 00:57:22,237 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 00:57:22,237 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817842237"}]},"ts":"1675817842237"} 2023-02-08 00:57:22,238 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-02-08 00:57:22,264 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 00:57:22,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4720 sec 2023-02-08 00:57:22,903 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:22,904 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:22,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=39 2023-02-08 00:57:22,905 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-02-08 00:57:22,930 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:22,931 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:22,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:22,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:22,933 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:22,933 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:22,933 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 00:57:22,933 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 00:57:22,934 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:22,934 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:23,153 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:23,153 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:23,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:23,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:23,154 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:23,154 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:23,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:23,155 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:23,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:23,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:23,157 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:23,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:23,157 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 00:57:23,157 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:23,157 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 00:57:23,158 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:23,158 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:23,158 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:23,158 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. started... 2023-02-08 00:57:23,159 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b259b18dbc55ddcae38c78ea5c268b7 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-08 00:57:23,583 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113020ff02ff174a4b76a0a3464528b2958d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113020ff02ff174a4b76a0a3464528b2958d 2023-02-08 00:57:23,988 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/86b6bcf5da7d454180351b45643d6e34 2023-02-08 00:57:23,996 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/86b6bcf5da7d454180351b45643d6e34 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/86b6bcf5da7d454180351b45643d6e34 2023-02-08 00:57:24,004 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/86b6bcf5da7d454180351b45643d6e34, entries=1000, sequenceid=5, filesize=191.4 K 2023-02-08 00:57:24,005 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 7b259b18dbc55ddcae38c78ea5c268b7 in 846ms, sequenceid=5, compaction requested=false 2023-02-08 00:57:24,005 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:24,006 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:24,006 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:24,006 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:24,006 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:24,006 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:24,006 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 00:57:24,006 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 00:57:24,137 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:24,137 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:24,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:24,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:24,139 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,139 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:24,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:24,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:24,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:24,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:24,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 00:57:24,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78da84cb[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:24,143 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 00:57:24,143 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,207 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,207 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 00:57:24,207 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 00:57:24,207 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:24,207 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:24,208 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:24,352 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:24,352 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 00:57:24,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:24,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:24,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:24,353 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:24,353 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 00:57:24,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:24,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:24,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:24,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:24,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:24,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:24,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 00:57:24,360 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 00:57:24,360 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:24,360 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:24,360 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,360 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:24,663 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,664 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,664 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:24,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:24,665 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:24,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:24,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:24,668 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:24,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:24,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:24,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:24,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:24,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:24,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:24,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:24,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:24,773 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:24,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:24,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 00:57:24,774 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:24,774 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:24,774 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:24,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:24,774 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:24,774 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,775 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,874 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:24,875 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:24,875 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:24,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:24,883 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:24,883 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:24,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:24,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:24,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,887 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:24,888 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:24,888 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 00:57:24,888 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 00:57:24,889 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:24,889 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:25,065 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:25,065 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:25,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:25,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:25,066 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:25,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:25,066 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:25,066 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:25,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:25,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:25,067 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:25,067 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 00:57:25,067 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:25,068 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 00:57:25,068 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:25,068 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 00:57:25,068 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:25,068 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:25,068 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:25,068 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. started... 2023-02-08 00:57:25,068 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b259b18dbc55ddcae38c78ea5c268b7 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-08 00:57:25,497 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289f103be8c96e46a794974d2592327ad1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511289f103be8c96e46a794974d2592327ad1 2023-02-08 00:57:25,905 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/25d8f0e721ed4048b039d79489b6ccb6 2023-02-08 00:57:25,909 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/25d8f0e721ed4048b039d79489b6ccb6 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/25d8f0e721ed4048b039d79489b6ccb6 2023-02-08 00:57:25,914 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/25d8f0e721ed4048b039d79489b6ccb6, entries=1, sequenceid=9, filesize=5.0 K 2023-02-08 00:57:25,914 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 7b259b18dbc55ddcae38c78ea5c268b7 in 846ms, sequenceid=9, compaction requested=false 2023-02-08 00:57:25,914 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:25,914 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:25,914 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:25,914 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:25,915 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:25,915 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 00:57:25,915 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 00:57:26,242 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:26,242 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:26,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:26,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:26,242 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,242 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:26,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:26,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 00:57:26,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6a11c294[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:26,243 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 00:57:26,243 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,404 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,405 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 00:57:26,405 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 00:57:26,405 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:26,405 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:26,405 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:26,415 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 00:57:26,415 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:26,415 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:26,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:26,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:26,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:26,415 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 00:57:26,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:26,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:26,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:26,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:26,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:26,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:26,420 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 00:57:26,420 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 00:57:26,420 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:26,420 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:26,420 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,420 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:26,436 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,436 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,436 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:26,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:26,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:26,437 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:26,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:26,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:26,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:26,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:26,441 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:26,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:26,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:26,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,798 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:26,798 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,799 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,799 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:26,799 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:26,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:26,799 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:26,799 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,799 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:26,800 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:26,800 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 00:57:26,800 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:26,800 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:26,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:26,800 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:26,802 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:26,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:26,901 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:26,902 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:26,902 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:26,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:26,912 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:26,913 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:26,914 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:26,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:26,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,917 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:26,917 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:26,917 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 00:57:26,917 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 00:57:26,917 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:26,917 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:27,212 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:27,212 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:27,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:27,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:27,213 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:27,213 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:27,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:27,213 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:27,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:27,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:27,213 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:27,213 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 00:57:27,213 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:27,213 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 00:57:27,213 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:27,213 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 00:57:27,214 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:27,214 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:27,214 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:27,214 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. started... 2023-02-08 00:57:27,214 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b259b18dbc55ddcae38c78ea5c268b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:27,633 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201109cf6977fad4f6295477299928d2555 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201109cf6977fad4f6295477299928d2555 2023-02-08 00:57:27,741 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:57:28,042 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/957b335ef03a4a649998b763672d97ec 2023-02-08 00:57:28,049 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/957b335ef03a4a649998b763672d97ec as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/957b335ef03a4a649998b763672d97ec 2023-02-08 00:57:28,056 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/957b335ef03a4a649998b763672d97ec, entries=1, sequenceid=13, filesize=5.0 K 2023-02-08 00:57:28,057 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b259b18dbc55ddcae38c78ea5c268b7 in 843ms, sequenceid=13, compaction requested=true 2023-02-08 00:57:28,057 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:28,057 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:28,057 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:28,057 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:28,057 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,057 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 00:57:28,057 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 00:57:28,310 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,310 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:28,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:28,311 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,312 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:28,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:28,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:28,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:28,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 00:57:28,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27c3ca65[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:28,316 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 00:57:28,316 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,330 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,331 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,331 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:28,331 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 00:57:28,331 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 00:57:28,331 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:28,341 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 00:57:28,341 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,341 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:28,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:28,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:28,341 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 00:57:28,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:28,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:28,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:28,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:28,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 00:57:28,344 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 00:57:28,344 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:28,344 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:28,344 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,345 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:28,362 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,362 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,362 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:28,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:28,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:28,363 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,364 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:28,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,704 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:28,704 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:28,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:28,705 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,705 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,705 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,706 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,706 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,706 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,704 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:28,706 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 00:57:28,705 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:28,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:28,708 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:28,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:28,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:28,709 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:28,709 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:28,809 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:28,810 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:28,810 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:28,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:28,816 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:28,816 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:28,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:28,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:28,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,822 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:28,822 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:28,822 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 00:57:28,822 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 00:57:28,822 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,822 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,920 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:28,920 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:28,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:28,921 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:28,921 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:28,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:28,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,924 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,924 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 00:57:28,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:28,925 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 00:57:28,925 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:28,925 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 00:57:28,925 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:28,925 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:28,925 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:28,925 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. started... 2023-02-08 00:57:28,926 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b259b18dbc55ddcae38c78ea5c268b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:29,349 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053591c8eb5e324a85b2a65dd2383be350 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512053591c8eb5e324a85b2a65dd2383be350 2023-02-08 00:57:29,754 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/bf8cb0ce28f04b3cae5bf2cd217d9d4f 2023-02-08 00:57:29,758 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/bf8cb0ce28f04b3cae5bf2cd217d9d4f as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/bf8cb0ce28f04b3cae5bf2cd217d9d4f 2023-02-08 00:57:29,763 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/bf8cb0ce28f04b3cae5bf2cd217d9d4f, entries=1, sequenceid=17, filesize=5.0 K 2023-02-08 00:57:29,764 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b259b18dbc55ddcae38c78ea5c268b7 in 838ms, sequenceid=17, compaction requested=true 2023-02-08 00:57:29,764 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:29,765 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:29,765 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:29,765 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:29,765 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:29,765 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 00:57:29,765 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 00:57:29,994 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:29,994 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:29,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:29,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:29,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:29,994 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:29,995 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:29,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:29,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:29,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:29,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:29,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:29,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 00:57:29,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bea8643[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:29,997 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 00:57:29,997 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,042 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,042 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,043 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 00:57:30,043 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 00:57:30,043 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:30,043 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:30,043 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:30,065 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 00:57:30,065 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:30,065 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:30,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:30,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:30,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:30,065 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 00:57:30,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:30,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:30,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:30,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:30,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:30,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:30,070 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 00:57:30,070 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 00:57:30,070 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:30,070 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:30,070 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,071 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:30,100 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,100 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:30,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:30,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,100 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:30,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:30,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:30,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:30,101 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:30,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:30,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,102 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:30,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:30,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:30,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:30,242 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:30,242 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,242 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,242 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:30,242 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:30,242 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:30,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:30,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:30,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:30,242 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,245 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 00:57:30,245 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:30,244 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:30,245 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:30,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:30,246 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:30,246 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:30,245 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,346 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:30,347 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:30,347 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:30,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:30,356 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:30,356 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:30,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:30,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:30,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,360 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:30,360 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:30,360 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 00:57:30,360 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 00:57:30,361 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,361 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,743 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:30,743 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:30,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:30,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:30,743 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:30,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,744 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:30,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:30,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,744 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,745 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 00:57:30,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:30,745 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 00:57:30,745 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:30,745 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 00:57:30,745 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:30,745 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:30,745 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:30,745 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. started... 2023-02-08 00:57:30,745 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b259b18dbc55ddcae38c78ea5c268b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:31,163 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512280f90df39a2f14c94959ab3a9559a62c1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512280f90df39a2f14c94959ab3a9559a62c1 2023-02-08 00:57:31,572 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/915b671b94804dbeaa4be82f070226d3 2023-02-08 00:57:31,577 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/915b671b94804dbeaa4be82f070226d3 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/915b671b94804dbeaa4be82f070226d3 2023-02-08 00:57:31,581 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/915b671b94804dbeaa4be82f070226d3, entries=1, sequenceid=21, filesize=5.0 K 2023-02-08 00:57:31,582 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b259b18dbc55ddcae38c78ea5c268b7 in 837ms, sequenceid=21, compaction requested=true 2023-02-08 00:57:31,582 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:31,582 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:31,582 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:31,582 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:31,582 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:31,582 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 00:57:31,582 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 00:57:31,686 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:31,686 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:31,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:31,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:31,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:31,686 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:31,686 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:31,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:31,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:31,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:31,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:31,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:31,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 00:57:31,688 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 00:57:31,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17baa129[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:31,688 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:31,730 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:31,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:31,730 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 00:57:31,730 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 00:57:31,730 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:31,730 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:31,730 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:31,763 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 00:57:31,763 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:31,763 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:31,763 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 00:57:31,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:31,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:31,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:31,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:31,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:31,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:31,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:31,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:31,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:31,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:31,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:31,766 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 00:57:31,766 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 00:57:31,766 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:31,766 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:31,766 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:31,766 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:32,057 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,057 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,057 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:32,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:32,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:32,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:32,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:32,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:32,060 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:32,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:32,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:32,062 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:32,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:32,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:32,089 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:32,089 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:32,089 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,089 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:32,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:32,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:32,089 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:32,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 00:57:32,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:32,090 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:32,089 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,090 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:32,090 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,090 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,090 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,090 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:32,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:32,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:32,090 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:32,191 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:32,191 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:32,191 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:32,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:32,202 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:32,202 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:32,203 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:32,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:32,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,205 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:32,205 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:32,205 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 00:57:32,205 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 00:57:32,206 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,206 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,446 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:32,446 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:32,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:32,446 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:32,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,446 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:32,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:32,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,447 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,448 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 00:57:32,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:32,448 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 00:57:32,448 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:32,448 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 00:57:32,448 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:32,448 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:32,448 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:32,448 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. started... 2023-02-08 00:57:32,449 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b259b18dbc55ddcae38c78ea5c268b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:33,071 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123142d6b803f9c44af8991002709abf3247 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123142d6b803f9c44af8991002709abf3247 2023-02-08 00:57:33,480 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/10303d17129e4845b94cf6fa0dc6d7d8 2023-02-08 00:57:33,486 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/10303d17129e4845b94cf6fa0dc6d7d8 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/10303d17129e4845b94cf6fa0dc6d7d8 2023-02-08 00:57:33,492 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/10303d17129e4845b94cf6fa0dc6d7d8, entries=1, sequenceid=25, filesize=5.0 K 2023-02-08 00:57:33,493 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b259b18dbc55ddcae38c78ea5c268b7 in 1044ms, sequenceid=25, compaction requested=true 2023-02-08 00:57:33,493 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:33,493 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:33,493 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:33,493 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:33,493 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:33,493 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 00:57:33,494 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 00:57:33,517 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,517 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:33,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:33,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:33,517 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,517 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:33,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:33,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:33,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:33,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:33,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:33,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 00:57:33,519 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 00:57:33,519 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@735bd428[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:33,519 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,818 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,818 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 00:57:33,818 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 00:57:33,818 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:33,818 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:33,818 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:33,839 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:33,839 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 00:57:33,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:33,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:33,839 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:33,840 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 00:57:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:33,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:33,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:33,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:33,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:33,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:33,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 00:57:33,845 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 00:57:33,845 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:33,845 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:33,845 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,845 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:33,873 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,873 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:33,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,873 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:33,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:33,874 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:33,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:33,874 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:33,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:33,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:33,877 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:33,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:33,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:33,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:33,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:34,207 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:34,207 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:34,207 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:34,207 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:34,207 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:34,207 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:34,209 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:34,207 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:34,210 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:34,210 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:34,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:34,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 00:57:34,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:34,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:34,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:34,211 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:34,211 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:34,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:34,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:34,312 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:34,312 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:34,312 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:34,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:34,317 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:34,317 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:34,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:34,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:34,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:34,319 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:34,319 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:34,319 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 00:57:34,319 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 00:57:34,320 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:34,320 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:34,341 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:34,341 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:34,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:34,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:34,341 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:34,341 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:34,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:34,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:34,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:34,342 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:34,342 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 00:57:34,342 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:34,343 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 00:57:34,343 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:34,343 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 00:57:34,343 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:34,343 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:34,343 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:34,343 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. started... 2023-02-08 00:57:34,343 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b259b18dbc55ddcae38c78ea5c268b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:34,756 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601019dc9c4624c174800b326e95f9a8a5dfb to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601019dc9c4624c174800b326e95f9a8a5dfb 2023-02-08 00:57:35,164 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/cfa1a4db22704bf5a81af9d98e4ffdb8 2023-02-08 00:57:35,173 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/cfa1a4db22704bf5a81af9d98e4ffdb8 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/cfa1a4db22704bf5a81af9d98e4ffdb8 2023-02-08 00:57:35,180 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/cfa1a4db22704bf5a81af9d98e4ffdb8, entries=1, sequenceid=29, filesize=5.0 K 2023-02-08 00:57:35,181 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b259b18dbc55ddcae38c78ea5c268b7 in 838ms, sequenceid=29, compaction requested=true 2023-02-08 00:57:35,181 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:35,181 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:35,181 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:35,181 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:35,181 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,181 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 00:57:35,182 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 00:57:35,477 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,477 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:35,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:35,478 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,478 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:35,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:35,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:35,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:35,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 00:57:35,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a72a8c4[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:35,479 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 00:57:35,479 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,502 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,503 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,503 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:35,503 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 00:57:35,503 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 00:57:35,503 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:35,577 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 00:57:35,577 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:35,577 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,577 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 00:57:35,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:35,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:35,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:35,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:35,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:35,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 00:57:35,586 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 00:57:35,586 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:35,586 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:35,586 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,586 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:35,957 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,957 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:35,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:35,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,958 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:35,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:35,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:35,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:35,959 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:35,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,963 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:35,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,993 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,993 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:35,993 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,993 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:35,993 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 00:57:35,993 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,994 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:35,994 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,994 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,994 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:35,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:35,993 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:35,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:35,993 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:35,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:35,995 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:35,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:35,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:35,995 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:36,095 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:36,095 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:36,095 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:36,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:36,099 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:36,099 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:36,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:36,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:36,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:36,101 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:36,102 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:36,102 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 00:57:36,102 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 00:57:36,102 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:36,102 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:36,372 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:36,372 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:36,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:36,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:36,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:36,372 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:36,372 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:36,372 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:36,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:36,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:36,373 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:36,373 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 00:57:36,373 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:36,373 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 00:57:36,373 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:36,373 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 00:57:36,373 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:36,373 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:36,373 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:36,374 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. started... 2023-02-08 00:57:36,374 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b259b18dbc55ddcae38c78ea5c268b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:36,786 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039140ed8063784a9a8f2540191b0e44c3 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601039140ed8063784a9a8f2540191b0e44c3 2023-02-08 00:57:36,790 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/516719edbf9d4d2e8b729e8760a4cfe8 2023-02-08 00:57:36,795 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/516719edbf9d4d2e8b729e8760a4cfe8 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/516719edbf9d4d2e8b729e8760a4cfe8 2023-02-08 00:57:36,800 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/516719edbf9d4d2e8b729e8760a4cfe8, entries=1, sequenceid=33, filesize=5.0 K 2023-02-08 00:57:36,801 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b259b18dbc55ddcae38c78ea5c268b7 in 427ms, sequenceid=33, compaction requested=true 2023-02-08 00:57:36,801 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:36,801 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:36,801 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:36,802 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:36,802 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:36,802 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 00:57:36,802 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 00:57:37,077 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,077 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:37,078 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,078 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:37,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 00:57:37,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@25c5f757[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:37,079 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 00:57:37,079 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,276 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,276 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 00:57:37,276 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 00:57:37,276 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:37,276 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,276 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:37,352 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,352 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 00:57:37,352 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:37,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,352 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 00:57:37,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:37,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:37,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:37,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:37,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:37,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:37,355 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 00:57:37,355 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 00:57:37,355 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:37,355 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:37,355 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,355 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:37,378 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,378 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:37,378 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,378 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:37,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:37,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:37,379 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:37,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,380 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:37,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,393 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,393 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,393 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,393 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:37,393 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:37,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:37,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:37,393 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:37,394 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 00:57:37,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:37,393 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:37,394 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,394 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,394 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:37,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:37,394 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:37,395 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:37,495 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:37,495 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:37,495 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:37,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:37,499 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:37,499 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:37,499 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:37,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:37,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,501 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:37,501 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:37,501 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 00:57:37,501 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 00:57:37,501 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,501 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,803 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:37,803 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:37,804 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:37,804 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:37,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,804 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,809 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 00:57:37,809 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:37,809 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 00:57:37,809 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:37,809 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 00:57:37,809 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:37,809 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:37,809 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:37,809 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. started... 2023-02-08 00:57:37,809 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b259b18dbc55ddcae38c78ea5c268b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:37,828 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907750605d1e0f84b069a01cfaa0d404a2a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907750605d1e0f84b069a01cfaa0d404a2a 2023-02-08 00:57:38,238 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/34599032c3404c1aa2b066ae9ab37496 2023-02-08 00:57:38,243 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/34599032c3404c1aa2b066ae9ab37496 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/34599032c3404c1aa2b066ae9ab37496 2023-02-08 00:57:38,248 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/34599032c3404c1aa2b066ae9ab37496, entries=1, sequenceid=37, filesize=5.0 K 2023-02-08 00:57:38,248 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b259b18dbc55ddcae38c78ea5c268b7 in 439ms, sequenceid=37, compaction requested=true 2023-02-08 00:57:38,249 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:38,249 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:38,249 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:38,249 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:38,249 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:38,249 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 00:57:38,249 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 00:57:38,593 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:38,593 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:38,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:38,594 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:38,594 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:38,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:38,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:38,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:38,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 00:57:38,596 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6734b92f[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:38,596 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 00:57:38,596 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,611 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,612 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 00:57:38,612 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 00:57:38,612 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:38,612 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:38,612 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:38,625 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 00:57:38,625 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:38,625 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:38,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:38,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:38,625 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 00:57:38,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:38,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:38,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:38,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:38,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:38,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:38,631 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 00:57:38,631 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 00:57:38,631 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:38,631 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:38,631 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,631 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:38,720 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,720 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:38,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:38,720 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:38,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,721 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:38,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:38,722 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:38,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:38,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:38,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:39,066 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:39,066 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:39,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:39,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:39,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:39,066 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:39,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:39,066 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:39,066 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:39,067 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:39,067 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:39,067 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:39,067 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:39,067 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:39,067 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 00:57:39,067 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:39,067 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:39,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:39,068 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:39,168 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:39,168 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:39,168 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:39,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:39,172 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:39,173 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:39,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:39,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:39,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:39,177 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:39,177 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:39,177 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-02-08 00:57:39,177 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-02-08 00:57:39,178 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:39,178 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:39,454 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:39,454 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:39,454 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:39,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:39,454 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:39,454 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:39,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:39,454 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:39,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:39,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:39,455 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:39,456 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-02-08 00:57:39,456 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:39,456 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-02-08 00:57:39,456 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:39,456 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-02-08 00:57:39,456 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:39,456 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:39,456 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:39,456 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. started... 2023-02-08 00:57:39,456 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 7b259b18dbc55ddcae38c78ea5c268b7 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:39,870 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511205346602f621141d3af472d69689b803a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511205346602f621141d3af472d69689b803a 2023-02-08 00:57:40,275 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/de485e1e4dc44b0b8755f02e4c842588 2023-02-08 00:57:40,281 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/de485e1e4dc44b0b8755f02e4c842588 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/de485e1e4dc44b0b8755f02e4c842588 2023-02-08 00:57:40,287 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/de485e1e4dc44b0b8755f02e4c842588, entries=1, sequenceid=41, filesize=5.0 K 2023-02-08 00:57:40,288 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 7b259b18dbc55ddcae38c78ea5c268b7 in 832ms, sequenceid=41, compaction requested=true 2023-02-08 00:57:40,288 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:40,288 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:40,288 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:40,288 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:40,288 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,288 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-02-08 00:57:40,289 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-02-08 00:57:40,393 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,393 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:40,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:40,393 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,393 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:40,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:40,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:40,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:40,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-02-08 00:57:40,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a63cb75[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:40,395 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-02-08 00:57:40,395 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,403 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,403 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-02-08 00:57:40,404 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,404 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:40,404 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-02-08 00:57:40,404 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:40,414 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-02-08 00:57:40,414 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,414 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:40,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:40,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:40,414 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-02-08 00:57:40,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:40,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:40,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:40,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:40,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-02-08 00:57:40,418 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-02-08 00:57:40,418 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:40,418 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:40,418 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,418 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:40,730 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,730 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:40,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,730 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:40,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:40,731 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:40,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:40,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:40,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,734 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:40,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,772 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:40,772 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:40,772 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:40,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:40,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:40,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:40,772 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-02-08 00:57:40,772 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:40,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,773 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:40,774 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:40,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:40,775 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,775 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:40,775 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:40,875 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:40,875 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:40,875 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:40,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:40,877 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:40,879 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 00:57:40,880 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 00:57:40,881 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:57:40,881 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818460881 2023-02-08 00:57:40,884 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 00:57:40,886 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-08 00:57:40,886 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 00:57:40,886 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x11d59297 to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:57:41,137 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67306638, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:57:41,137 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:41,992 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f739adec01c440febc8176569adb1023 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103f739adec01c440febc8176569adb1023 2023-02-08 00:57:41,994 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 00:57:42,010 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:57:42,011 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:49852, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:57:42,017 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:42,017 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:42,018 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:57:42,019 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:57004, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:57:42,029 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f3bad9470d6d40cbba4a3d044d246c8f first=Optional[r3] last=Optional[r6] 2023-02-08 00:57:42,030 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f3bad9470d6d40cbba4a3d044d246c8f}] 2023-02-08 00:57:42,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f3bad9470d6d40cbba4a3d044d246c8f for inclusion in 7b259b18dbc55ddcae38c78ea5c268b7/family1 2023-02-08 00:57:42,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-08 00:57:42,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:57:42,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:42,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/f3bad9470d6d40cbba4a3d044d246c8f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__8fubrop5m3h49lt8ev6qap1oc189depbugc9l8k036k61s71ul359vhib9q8akso/family1/f3bad9470d6d40cbba4a3d044d246c8f 2023-02-08 00:57:42,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__8fubrop5m3h49lt8ev6qap1oc189depbugc9l8k036k61s71ul359vhib9q8akso/family1/f3bad9470d6d40cbba4a3d044d246c8f as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/619cf4e66a9a4c5c92e1bb27f0e34bac_SeqId_44_ 2023-02-08 00:57:42,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__8fubrop5m3h49lt8ev6qap1oc189depbugc9l8k036k61s71ul359vhib9q8akso/family1/f3bad9470d6d40cbba4a3d044d246c8f into 7b259b18dbc55ddcae38c78ea5c268b7/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/619cf4e66a9a4c5c92e1bb27f0e34bac_SeqId_44_ - updating store file list. 2023-02-08 00:57:42,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/619cf4e66a9a4c5c92e1bb27f0e34bac_SeqId_44_ into 7b259b18dbc55ddcae38c78ea5c268b7/family1 2023-02-08 00:57:42,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__8fubrop5m3h49lt8ev6qap1oc189depbugc9l8k036k61s71ul359vhib9q8akso/family1/f3bad9470d6d40cbba4a3d044d246c8f into 7b259b18dbc55ddcae38c78ea5c268b7/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/619cf4e66a9a4c5c92e1bb27f0e34bac_SeqId_44_) 2023-02-08 00:57:42,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__8fubrop5m3h49lt8ev6qap1oc189depbugc9l8k036k61s71ul359vhib9q8akso/family1/f3bad9470d6d40cbba4a3d044d246c8f 2023-02-08 00:57:42,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-08 00:57:42,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-08 00:57:42,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 7b259b18dbc55ddcae38c78ea5c268b7/family1 is initiating minor compaction 2023-02-08 00:57:42,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@57e005b4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:57:42,050 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 7b259b18dbc55ddcae38c78ea5c268b7/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:42,050 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/25d8f0e721ed4048b039d79489b6ccb6, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/957b335ef03a4a649998b763672d97ec, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/bf8cb0ce28f04b3cae5bf2cd217d9d4f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/915b671b94804dbeaa4be82f070226d3, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/10303d17129e4845b94cf6fa0dc6d7d8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/cfa1a4db22704bf5a81af9d98e4ffdb8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/516719edbf9d4d2e8b729e8760a4cfe8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/34599032c3404c1aa2b066ae9ab37496, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/de485e1e4dc44b0b8755f02e4c842588, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/619cf4e66a9a4c5c92e1bb27f0e34bac_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp, totalSize=50.4 K 2023-02-08 00:57:42,051 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 25d8f0e721ed4048b039d79489b6ccb6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 00:57:42,051 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 957b335ef03a4a649998b763672d97ec, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 00:57:42,051 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting bf8cb0ce28f04b3cae5bf2cd217d9d4f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-08 00:57:42,051 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 915b671b94804dbeaa4be82f070226d3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-08 00:57:42,051 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 10303d17129e4845b94cf6fa0dc6d7d8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-08 00:57:42,051 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting cfa1a4db22704bf5a81af9d98e4ffdb8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-08 00:57:42,051 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 516719edbf9d4d2e8b729e8760a4cfe8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-08 00:57:42,051 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 34599032c3404c1aa2b066ae9ab37496, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-08 00:57:42,051 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting de485e1e4dc44b0b8755f02e4c842588, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-08 00:57:42,051 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 619cf4e66a9a4c5c92e1bb27f0e34bac_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-08 00:57:42,052 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 00:57:42,053 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:57:42,055 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512280f90df39a2f14c94959ab3a9559a62c1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512280f90df39a2f14c94959ab3a9559a62c1 2023-02-08 00:57:42,056 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123142d6b803f9c44af8991002709abf3247 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015123142d6b803f9c44af8991002709abf3247 2023-02-08 00:57:42,057 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601019dc9c4624c174800b326e95f9a8a5dfb to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601019dc9c4624c174800b326e95f9a8a5dfb 2023-02-08 00:57:42,058 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601039140ed8063784a9a8f2540191b0e44c3 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601039140ed8063784a9a8f2540191b0e44c3 2023-02-08 00:57:42,058 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-02-08 00:57:42,058 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-08 00:57:42,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:42,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:42,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:42,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:42,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:42,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:42,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:42,058 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:42,087 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7b259b18dbc55ddcae38c78ea5c268b7#family1#compaction#61 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-08 00:57:42,904 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/504cd6d4838d4bc4995631e6d09dc474 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/504cd6d4838d4bc4995631e6d09dc474 2023-02-08 00:57:42,909 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 7b259b18dbc55ddcae38c78ea5c268b7/family1 of 7b259b18dbc55ddcae38c78ea5c268b7 into 504cd6d4838d4bc4995631e6d09dc474(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:57:42,909 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:42,909 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1675817862050; duration=0sec 2023-02-08 00:57:42,910 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:57:42,915 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205f624cde99b2145609969b67c719fe8b3 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205f624cde99b2145609969b67c719fe8b3 2023-02-08 00:57:42,916 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 00:57:42,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/25d8f0e721ed4048b039d79489b6ccb6, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/957b335ef03a4a649998b763672d97ec, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/bf8cb0ce28f04b3cae5bf2cd217d9d4f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/915b671b94804dbeaa4be82f070226d3, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/10303d17129e4845b94cf6fa0dc6d7d8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/cfa1a4db22704bf5a81af9d98e4ffdb8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/516719edbf9d4d2e8b729e8760a4cfe8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/34599032c3404c1aa2b066ae9ab37496, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/de485e1e4dc44b0b8755f02e4c842588, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/619cf4e66a9a4c5c92e1bb27f0e34bac_SeqId_44_] to archive 2023-02-08 00:57:42,927 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:57:42,928 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/25d8f0e721ed4048b039d79489b6ccb6 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/25d8f0e721ed4048b039d79489b6ccb6 2023-02-08 00:57:42,929 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/957b335ef03a4a649998b763672d97ec to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/957b335ef03a4a649998b763672d97ec 2023-02-08 00:57:42,930 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/bf8cb0ce28f04b3cae5bf2cd217d9d4f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/bf8cb0ce28f04b3cae5bf2cd217d9d4f 2023-02-08 00:57:42,931 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/915b671b94804dbeaa4be82f070226d3 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/915b671b94804dbeaa4be82f070226d3 2023-02-08 00:57:42,932 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/10303d17129e4845b94cf6fa0dc6d7d8 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/10303d17129e4845b94cf6fa0dc6d7d8 2023-02-08 00:57:42,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/cfa1a4db22704bf5a81af9d98e4ffdb8 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/cfa1a4db22704bf5a81af9d98e4ffdb8 2023-02-08 00:57:42,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/516719edbf9d4d2e8b729e8760a4cfe8 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/516719edbf9d4d2e8b729e8760a4cfe8 2023-02-08 00:57:42,934 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/34599032c3404c1aa2b066ae9ab37496 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/34599032c3404c1aa2b066ae9ab37496 2023-02-08 00:57:42,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/de485e1e4dc44b0b8755f02e4c842588 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/de485e1e4dc44b0b8755f02e4c842588 2023-02-08 00:57:42,936 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/619cf4e66a9a4c5c92e1bb27f0e34bac_SeqId_44_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/619cf4e66a9a4c5c92e1bb27f0e34bac_SeqId_44_ 2023-02-08 00:57:42,943 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:42,943 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:42,949 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f61706460fac49f680d29236e2136fe9 first=Optional[r00] last=Optional[r2] 2023-02-08 00:57:42,950 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f61706460fac49f680d29236e2136fe9}] 2023-02-08 00:57:42,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f61706460fac49f680d29236e2136fe9 for inclusion in 7b259b18dbc55ddcae38c78ea5c268b7/family1 2023-02-08 00:57:42,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-08 00:57:42,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:57:42,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:42,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f61706460fac49f680d29236e2136fe9 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__m2objcg17dh0p0prlrs1iq26oja3o9v5f77nf69bk91cl9tntde41b0foi8ip27n/family1/f61706460fac49f680d29236e2136fe9 2023-02-08 00:57:42,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__m2objcg17dh0p0prlrs1iq26oja3o9v5f77nf69bk91cl9tntde41b0foi8ip27n/family1/f61706460fac49f680d29236e2136fe9 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/25cf3e211f6f4cce8880831d6d6372a3_SeqId_47_ 2023-02-08 00:57:42,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__m2objcg17dh0p0prlrs1iq26oja3o9v5f77nf69bk91cl9tntde41b0foi8ip27n/family1/f61706460fac49f680d29236e2136fe9 into 7b259b18dbc55ddcae38c78ea5c268b7/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/25cf3e211f6f4cce8880831d6d6372a3_SeqId_47_ - updating store file list. 2023-02-08 00:57:42,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/25cf3e211f6f4cce8880831d6d6372a3_SeqId_47_ into 7b259b18dbc55ddcae38c78ea5c268b7/family1 2023-02-08 00:57:42,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__m2objcg17dh0p0prlrs1iq26oja3o9v5f77nf69bk91cl9tntde41b0foi8ip27n/family1/f61706460fac49f680d29236e2136fe9 into 7b259b18dbc55ddcae38c78ea5c268b7/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/25cf3e211f6f4cce8880831d6d6372a3_SeqId_47_) 2023-02-08 00:57:42,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__m2objcg17dh0p0prlrs1iq26oja3o9v5f77nf69bk91cl9tntde41b0foi8ip27n/family1/f61706460fac49f680d29236e2136fe9 2023-02-08 00:57:42,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 00:57:42,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 00:57:42,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 7b259b18dbc55ddcae38c78ea5c268b7/family1 is initiating minor compaction (all files) 2023-02-08 00:57:42,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6ac70f09; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:57:42,964 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 7b259b18dbc55ddcae38c78ea5c268b7/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:42,965 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/86b6bcf5da7d454180351b45643d6e34, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/504cd6d4838d4bc4995631e6d09dc474, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/25cf3e211f6f4cce8880831d6d6372a3_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp, totalSize=390.1 K 2023-02-08 00:57:42,965 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 86b6bcf5da7d454180351b45643d6e34, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878836759 2023-02-08 00:57:42,966 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 504cd6d4838d4bc4995631e6d09dc474, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621236759 2023-02-08 00:57:42,966 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 25cf3e211f6f4cce8880831d6d6372a3_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878836759 2023-02-08 00:57:42,967 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 00:57:42,967 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:57:42,972 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113020ff02ff174a4b76a0a3464528b2958d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113020ff02ff174a4b76a0a3464528b2958d 2023-02-08 00:57:42,973 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201109cf6977fad4f6295477299928d2555 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201109cf6977fad4f6295477299928d2555 2023-02-08 00:57:42,974 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512053591c8eb5e324a85b2a65dd2383be350 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512053591c8eb5e324a85b2a65dd2383be350 2023-02-08 00:57:42,974 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-02-08 00:57:42,974 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-08 00:57:42,975 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:42,975 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 00:57:42,975 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:57:42,976 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 00:57:42,977 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 2.0980 sec 2023-02-08 00:57:42,987 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 7b259b18dbc55ddcae38c78ea5c268b7#family1#compaction#62 average throughput is 22.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-08 00:57:43,043 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:43,043 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:43,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-08 00:57:43,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:43,408 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/.tmp/family1/5645bd41d7774bde91359734ff515dab as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/5645bd41d7774bde91359734ff515dab 2023-02-08 00:57:43,413 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 7b259b18dbc55ddcae38c78ea5c268b7/family1 of 7b259b18dbc55ddcae38c78ea5c268b7 into 5645bd41d7774bde91359734ff515dab(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:57:43,413 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:43,413 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1675817862964; duration=0sec 2023-02-08 00:57:43,413 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:57:43,427 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/86b6bcf5da7d454180351b45643d6e34, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/504cd6d4838d4bc4995631e6d09dc474, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/25cf3e211f6f4cce8880831d6d6372a3_SeqId_47_] to archive 2023-02-08 00:57:43,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:57:43,430 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/86b6bcf5da7d454180351b45643d6e34 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/86b6bcf5da7d454180351b45643d6e34 2023-02-08 00:57:43,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/504cd6d4838d4bc4995631e6d09dc474 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/504cd6d4838d4bc4995631e6d09dc474 2023-02-08 00:57:43,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/25cf3e211f6f4cce8880831d6d6372a3_SeqId_47_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/25cf3e211f6f4cce8880831d6d6372a3_SeqId_47_ 2023-02-08 00:57:43,454 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-08 00:57:43,456 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-02-08 00:57:43,456 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-08 00:57:43,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-08 00:57:43,463 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7b259b18dbc55ddcae38c78ea5c268b7, REOPEN/MOVE}] 2023-02-08 00:57:43,464 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7b259b18dbc55ddcae38c78ea5c268b7, REOPEN/MOVE 2023-02-08 00:57:43,465 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=7b259b18dbc55ddcae38c78ea5c268b7, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:43,465 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675817863465"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817863465"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817863465"}]},"ts":"1675817863465"} 2023-02-08 00:57:43,467 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure 7b259b18dbc55ddcae38c78ea5c268b7, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:57:43,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:43,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 7b259b18dbc55ddcae38c78ea5c268b7, disabling compactions & flushes 2023-02-08 00:57:43,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:43,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:43,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. after waiting 0 ms 2023-02-08 00:57:43,620 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:43,632 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-08 00:57:43,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:43,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 7b259b18dbc55ddcae38c78ea5c268b7: Waiting for close lock at 1675817863620Running coprocessor pre-close hooks at 1675817863620Disabling compacts and flushes for region at 1675817863620Disabling writes for close at 1675817863620Writing region close event to WAL at 1675817863624 (+4 ms)Running coprocessor post-close hooks at 1675817863633 (+9 ms)Closed at 1675817863634 (+1 ms) 2023-02-08 00:57:43,634 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 7b259b18dbc55ddcae38c78ea5c268b7 to self. 2023-02-08 00:57:43,637 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:43,638 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=7b259b18dbc55ddcae38c78ea5c268b7, regionState=CLOSED 2023-02-08 00:57:43,638 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675817863637"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817863637"}]},"ts":"1675817863637"} 2023-02-08 00:57:43,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=45 2023-02-08 00:57:43,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure 7b259b18dbc55ddcae38c78ea5c268b7, server=jenkins-hbase12.apache.org,36907,1675817727419 in 173 msec 2023-02-08 00:57:43,643 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7b259b18dbc55ddcae38c78ea5c268b7, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=true 2023-02-08 00:57:43,793 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=7b259b18dbc55ddcae38c78ea5c268b7, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:43,793 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675817863793"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817863793"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817863793"}]},"ts":"1675817863793"} 2023-02-08 00:57:43,795 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure 7b259b18dbc55ddcae38c78ea5c268b7, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:57:43,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:43,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7b259b18dbc55ddcae38c78ea5c268b7, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:57:43,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:43,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:57:43,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:43,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:43,982 INFO [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:43,983 DEBUG [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1 2023-02-08 00:57:43,983 DEBUG [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1 2023-02-08 00:57:43,983 INFO [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b259b18dbc55ddcae38c78ea5c268b7 columnFamilyName family1 2023-02-08 00:57:43,993 DEBUG [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/5645bd41d7774bde91359734ff515dab 2023-02-08 00:57:43,993 INFO [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] regionserver.HStore(310): Store=7b259b18dbc55ddcae38c78ea5c268b7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:57:43,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:43,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:43,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:43,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 7b259b18dbc55ddcae38c78ea5c268b7; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60435814, jitterRate=-0.0994361937046051}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:57:43,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 7b259b18dbc55ddcae38c78ea5c268b7: Running coprocessor pre-open hook at 1675817863980Writing region info on filesystem at 1675817863980Initializing all the Stores at 1675817863981 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675817863981Cleaning up temporary data from old regions at 1675817863996 (+15 ms)Cleaning up detritus from prior splits at 1675817863996Running coprocessor post-open hooks at 1675817863999 (+3 ms)Region opened successfully at 1675817863999 2023-02-08 00:57:44,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7., pid=47, masterSystemTime=1675817863947 2023-02-08 00:57:44,002 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:44,002 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:44,002 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=7b259b18dbc55ddcae38c78ea5c268b7, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:44,002 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675817864002"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817864002"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817864002"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817864002"}]},"ts":"1675817864002"} 2023-02-08 00:57:44,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=47, resume processing ppid=45 2023-02-08 00:57:44,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure 7b259b18dbc55ddcae38c78ea5c268b7, server=jenkins-hbase12.apache.org,36907,1675817727419 in 209 msec 2023-02-08 00:57:44,015 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-02-08 00:57:44,016 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7b259b18dbc55ddcae38c78ea5c268b7, REOPEN/MOVE in 550 msec 2023-02-08 00:57:44,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=44, resume processing ppid=43 2023-02-08 00:57:44,019 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 558 msec 2023-02-08 00:57:44,021 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 976 msec 2023-02-08 00:57:44,022 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:44,022 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:44,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=43 2023-02-08 00:57:44,023 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:44,023 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:44,023 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:44,023 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:44,024 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(278): alter status finished 2023-02-08 00:57:44,024 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:44,026 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 00:57:44,026 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 00:57:44,027 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:57:44,027 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818464027 2023-02-08 00:57:44,028 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 00:57:44,028 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-08 00:57:44,028 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 00:57:44,029 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x4eecd31b to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:57:44,114 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a097d58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:57:44,114 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:44,114 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:44,114 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:44,114 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:44,115 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:44,954 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511282a73e77102bc45dda86374df9ab8b1b0 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511282a73e77102bc45dda86374df9ab8b1b0 2023-02-08 00:57:44,955 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 00:57:44,972 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:57:44,973 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:33850, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:57:44,983 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:44,983 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:44,984 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:57:44,986 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:32956, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:57:44,996 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d741e6cd417041adbc07cc7c9d3f964b first=Optional[r05] last=Optional[r8] 2023-02-08 00:57:44,996 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d741e6cd417041adbc07cc7c9d3f964b}] 2023-02-08 00:57:45,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d741e6cd417041adbc07cc7c9d3f964b for inclusion in 7b259b18dbc55ddcae38c78ea5c268b7/family1 2023-02-08 00:57:45,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-08 00:57:45,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:57:45,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 7b259b18dbc55ddcae38c78ea5c268b7: 2023-02-08 00:57:45,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d741e6cd417041adbc07cc7c9d3f964b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__btruc6al8vtj55vtiip8htilh8mj5u7umjanah2b8j0do8uo0f8p88c7d39jvn4d/family1/d741e6cd417041adbc07cc7c9d3f964b 2023-02-08 00:57:45,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__btruc6al8vtj55vtiip8htilh8mj5u7umjanah2b8j0do8uo0f8p88c7d39jvn4d/family1/d741e6cd417041adbc07cc7c9d3f964b as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/6c3e75d2a8114856b1c99c82b30dd07f_SeqId_53_ 2023-02-08 00:57:45,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__btruc6al8vtj55vtiip8htilh8mj5u7umjanah2b8j0do8uo0f8p88c7d39jvn4d/family1/d741e6cd417041adbc07cc7c9d3f964b into 7b259b18dbc55ddcae38c78ea5c268b7/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/6c3e75d2a8114856b1c99c82b30dd07f_SeqId_53_ - updating store file list. 2023-02-08 00:57:45,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/6c3e75d2a8114856b1c99c82b30dd07f_SeqId_53_ into 7b259b18dbc55ddcae38c78ea5c268b7/family1 2023-02-08 00:57:45,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__btruc6al8vtj55vtiip8htilh8mj5u7umjanah2b8j0do8uo0f8p88c7d39jvn4d/family1/d741e6cd417041adbc07cc7c9d3f964b into 7b259b18dbc55ddcae38c78ea5c268b7/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/6c3e75d2a8114856b1c99c82b30dd07f_SeqId_53_) 2023-02-08 00:57:45,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__btruc6al8vtj55vtiip8htilh8mj5u7umjanah2b8j0do8uo0f8p88c7d39jvn4d/family1/d741e6cd417041adbc07cc7c9d3f964b 2023-02-08 00:57:45,016 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 00:57:45,017 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:57:45,019 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511205346602f621141d3af472d69689b803a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511205346602f621141d3af472d69689b803a 2023-02-08 00:57:45,020 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511289f103be8c96e46a794974d2592327ad1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511289f103be8c96e46a794974d2592327ad1 2023-02-08 00:57:45,020 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-02-08 00:57:45,021 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-08 00:57:45,021 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:45,021 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:45,021 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:45,021 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 00:57:45,021 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:57:45,022 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 00:57:45,024 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 997 msec 2023-02-08 00:57:45,077 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:45,077 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:45,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-08 00:57:45,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:45,489 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-08 00:57:45,490 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-02-08 00:57:45,490 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-02-08 00:57:45,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-02-08 00:57:45,499 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7b259b18dbc55ddcae38c78ea5c268b7, REOPEN/MOVE}] 2023-02-08 00:57:45,500 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7b259b18dbc55ddcae38c78ea5c268b7, REOPEN/MOVE 2023-02-08 00:57:45,500 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=7b259b18dbc55ddcae38c78ea5c268b7, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:45,501 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675817865500"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817865500"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817865500"}]},"ts":"1675817865500"} 2023-02-08 00:57:45,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure 7b259b18dbc55ddcae38c78ea5c268b7, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:57:45,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:45,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 7b259b18dbc55ddcae38c78ea5c268b7, disabling compactions & flushes 2023-02-08 00:57:45,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:45,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:45,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. after waiting 0 ms 2023-02-08 00:57:45,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:45,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-08 00:57:45,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:45,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 7b259b18dbc55ddcae38c78ea5c268b7: Waiting for close lock at 1675817865654Running coprocessor pre-close hooks at 1675817865654Disabling compacts and flushes for region at 1675817865654Disabling writes for close at 1675817865654Writing region close event to WAL at 1675817865657 (+3 ms)Running coprocessor post-close hooks at 1675817865660 (+3 ms)Closed at 1675817865660 2023-02-08 00:57:45,660 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 7b259b18dbc55ddcae38c78ea5c268b7 to self. 2023-02-08 00:57:45,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:45,662 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=7b259b18dbc55ddcae38c78ea5c268b7, regionState=CLOSED 2023-02-08 00:57:45,662 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675817865662"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817865662"}]},"ts":"1675817865662"} 2023-02-08 00:57:45,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-02-08 00:57:45,665 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure 7b259b18dbc55ddcae38c78ea5c268b7, server=jenkins-hbase12.apache.org,36907,1675817727419 in 161 msec 2023-02-08 00:57:45,665 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7b259b18dbc55ddcae38c78ea5c268b7, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=true 2023-02-08 00:57:45,816 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=7b259b18dbc55ddcae38c78ea5c268b7, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:45,816 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675817865816"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817865816"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817865816"}]},"ts":"1675817865816"} 2023-02-08 00:57:45,818 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure 7b259b18dbc55ddcae38c78ea5c268b7, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:57:45,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:45,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 7b259b18dbc55ddcae38c78ea5c268b7, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:57:45,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:45,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:57:45,977 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:45,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:45,981 INFO [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:45,982 DEBUG [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1 2023-02-08 00:57:45,982 DEBUG [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1 2023-02-08 00:57:45,983 INFO [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7b259b18dbc55ddcae38c78ea5c268b7 columnFamilyName family1 2023-02-08 00:57:45,993 DEBUG [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/5645bd41d7774bde91359734ff515dab 2023-02-08 00:57:46,000 DEBUG [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/family1/6c3e75d2a8114856b1c99c82b30dd07f_SeqId_53_ 2023-02-08 00:57:46,000 INFO [StoreOpener-7b259b18dbc55ddcae38c78ea5c268b7-1] regionserver.HStore(310): Store=7b259b18dbc55ddcae38c78ea5c268b7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:57:46,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:46,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:46,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 00:57:46,007 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 7b259b18dbc55ddcae38c78ea5c268b7; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72526188, jitterRate=0.08072441816329956}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:57:46,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 7b259b18dbc55ddcae38c78ea5c268b7: Running coprocessor pre-open hook at 1675817865978Writing region info on filesystem at 1675817865978Initializing all the Stores at 1675817865980 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675817865980Cleaning up temporary data from old regions at 1675817866004 (+24 ms)Cleaning up detritus from prior splits at 1675817866005 (+1 ms)Running coprocessor post-open hooks at 1675817866007 (+2 ms)Region opened successfully at 1675817866007 2023-02-08 00:57:46,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7., pid=53, masterSystemTime=1675817865970 2023-02-08 00:57:46,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:46,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 00:57:46,009 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=7b259b18dbc55ddcae38c78ea5c268b7, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:46,009 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1675817866009"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817866009"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817866009"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817866009"}]},"ts":"1675817866009"} 2023-02-08 00:57:46,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-02-08 00:57:46,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure 7b259b18dbc55ddcae38c78ea5c268b7, server=jenkins-hbase12.apache.org,36907,1675817727419 in 193 msec 2023-02-08 00:57:46,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=51, resume processing ppid=50 2023-02-08 00:57:46,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=7b259b18dbc55ddcae38c78ea5c268b7, REOPEN/MOVE in 513 msec 2023-02-08 00:57:46,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=50, resume processing ppid=49 2023-02-08 00:57:46,015 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 518 msec 2023-02-08 00:57:46,017 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 936 msec 2023-02-08 00:57:46,017 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:46,017 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:46,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=49 2023-02-08 00:57:46,018 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:46,018 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:46,019 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:46,019 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:46,019 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(278): alter status finished 2023-02-08 00:57:46,020 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-02-08 00:57:46,022 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 00:57:46,023 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 00:57:46,024 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818466024 2023-02-08 00:57:46,024 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:57:46,024 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 00:57:46,025 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-02-08 00:57:46,025 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 00:57:46,025 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x431fee1f to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:57:46,070 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@221db899, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:57:46,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:46,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:46,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:46,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:46,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:46,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:46,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:46,071 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-02-08 00:57:46,071 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-02-08 00:57:46,071 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:57:46,073 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-02-08 00:57:46,074 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 52 msec 2023-02-08 00:57:46,129 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=241 (was 242), OpenFileDescriptor=607 (was 579) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=367 (was 316) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 175), AvailableMemoryMB=4138 (was 3317) - AvailableMemoryMB LEAK? - 2023-02-08 00:57:46,141 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=241, OpenFileDescriptor=607, MaxFileDescriptor=60000, SystemLoadAverage=367, ProcessCount=175, AvailableMemoryMB=4138 2023-02-08 00:57:46,142 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:46,142 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:46,143 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-02-08 00:57:46,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:46,146 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 00:57:46,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-02-08 00:57:46,146 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:46,146 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:46,146 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 00:57:46,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-08 00:57:46,147 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:57:46,148 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d empty. 2023-02-08 00:57:46,148 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:57:46,148 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-02-08 00:57:46,159 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-08 00:57:46,161 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7671): creating {ENCODED => 1b4691ee9ccf8ff7c27159984cbea63d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:57:46,247 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:46,247 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:46,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-08 00:57:46,449 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:46,450 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:46,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-08 00:57:46,567 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:57:46,567 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1603): Closing 1b4691ee9ccf8ff7c27159984cbea63d, disabling compactions & flushes 2023-02-08 00:57:46,567 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:46,567 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:46,567 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. after waiting 0 ms 2023-02-08 00:57:46,567 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:46,568 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:46,568 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1557): Region close journal for 1b4691ee9ccf8ff7c27159984cbea63d: Waiting for close lock at 1675817866567Disabling compacts and flushes for region at 1675817866567Disabling writes for close at 1675817866567Writing region close event to WAL at 1675817866568 (+1 ms)Closed at 1675817866568 2023-02-08 00:57:46,573 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 00:57:46,576 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675817866575"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817866575"}]},"ts":"1675817866575"} 2023-02-08 00:57:46,578 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 00:57:46,578 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 00:57:46,579 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817866579"}]},"ts":"1675817866579"} 2023-02-08 00:57:46,580 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-02-08 00:57:46,752 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:46,753 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:46,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-08 00:57:46,928 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1b4691ee9ccf8ff7c27159984cbea63d, ASSIGN}] 2023-02-08 00:57:46,931 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1b4691ee9ccf8ff7c27159984cbea63d, ASSIGN 2023-02-08 00:57:46,932 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1b4691ee9ccf8ff7c27159984cbea63d, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:57:47,083 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=1b4691ee9ccf8ff7c27159984cbea63d, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:47,084 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675817867083"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817867083"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817867083"}]},"ts":"1675817867083"} 2023-02-08 00:57:47,085 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 1b4691ee9ccf8ff7c27159984cbea63d, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:57:47,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:47,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1b4691ee9ccf8ff7c27159984cbea63d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:57:47,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:57:47,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:57:47,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:57:47,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:57:47,244 INFO [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:57:47,246 DEBUG [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1 2023-02-08 00:57:47,246 DEBUG [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1 2023-02-08 00:57:47,247 INFO [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b4691ee9ccf8ff7c27159984cbea63d columnFamilyName family1 2023-02-08 00:57:47,250 INFO [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] regionserver.HStore(310): Store=1b4691ee9ccf8ff7c27159984cbea63d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:57:47,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:57:47,252 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:57:47,256 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:47,256 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:47,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-08 00:57:47,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:57:47,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:57:47,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 1b4691ee9ccf8ff7c27159984cbea63d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75298733, jitterRate=0.12203855812549591}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:57:47,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 1b4691ee9ccf8ff7c27159984cbea63d: Running coprocessor pre-open hook at 1675817867242Writing region info on filesystem at 1675817867242Initializing all the Stores at 1675817867243 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} at 1675817867243Cleaning up temporary data from old regions at 1675817867253 (+10 ms)Cleaning up detritus from prior splits at 1675817867254 (+1 ms)Running coprocessor post-open hooks at 1675817867262 (+8 ms)Region opened successfully at 1675817867262 2023-02-08 00:57:47,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d., pid=57, masterSystemTime=1675817867238 2023-02-08 00:57:47,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:47,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:47,265 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=1b4691ee9ccf8ff7c27159984cbea63d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:47,265 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675817867265"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817867265"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817867265"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817867265"}]},"ts":"1675817867265"} 2023-02-08 00:57:47,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=57, resume processing ppid=56 2023-02-08 00:57:47,267 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 1b4691ee9ccf8ff7c27159984cbea63d, server=jenkins-hbase12.apache.org,36907,1675817727419 in 181 msec 2023-02-08 00:57:47,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=56, resume processing ppid=55 2023-02-08 00:57:47,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1b4691ee9ccf8ff7c27159984cbea63d, ASSIGN in 339 msec 2023-02-08 00:57:47,269 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 00:57:47,269 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817867269"}]},"ts":"1675817867269"} 2023-02-08 00:57:47,270 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-02-08 00:57:47,434 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 00:57:47,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.2900 sec 2023-02-08 00:57:48,257 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:48,258 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:48,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=55 2023-02-08 00:57:48,259 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-02-08 00:57:48,292 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:48,292 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:48,293 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:48,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:48,294 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:57:48,294 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:48,294 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 00:57:48,294 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 00:57:48,295 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:48,295 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:48,327 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:48,327 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:48,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:48,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:48,327 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:48,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:48,328 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:48,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:48,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:48,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:48,328 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:48,328 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:48,328 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 00:57:48,329 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:48,329 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 00:57:48,329 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:48,329 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:48,329 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:48,329 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. started... 2023-02-08 00:57:48,330 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1b4691ee9ccf8ff7c27159984cbea63d 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-08 00:57:48,752 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130e471c5f0b4884d78a67b5ed04fca4092 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e471c5f0b4884d78a67b5ed04fca4092 2023-02-08 00:57:49,157 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:57:49,168 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/ddf1775511624c8cafb04572cd993d12 2023-02-08 00:57:49,188 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/ddf1775511624c8cafb04572cd993d12 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/ddf1775511624c8cafb04572cd993d12 2023-02-08 00:57:49,195 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/ddf1775511624c8cafb04572cd993d12, entries=1000, sequenceid=5, filesize=190.5 K 2023-02-08 00:57:49,196 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 1b4691ee9ccf8ff7c27159984cbea63d in 866ms, sequenceid=5, compaction requested=false 2023-02-08 00:57:49,196 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:57:49,196 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:57:49,196 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:49,196 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:49,196 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:49,196 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,196 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 00:57:49,196 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 00:57:49,466 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,466 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:49,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:49,466 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,466 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:49,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:49,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:49,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:49,467 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 00:57:49,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15087e75[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:49,468 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 00:57:49,468 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,634 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,635 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 00:57:49,635 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 00:57:49,635 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:49,635 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,635 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:49,645 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 00:57:49,645 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:49,645 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 00:57:49,645 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:49,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:49,647 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 00:57:49,649 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 00:57:49,649 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:49,649 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:49,649 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,649 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:49,687 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,687 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:49,687 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:49,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:49,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,688 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,688 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:49,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,766 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,766 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,766 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:49,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 00:57:49,766 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:49,767 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:49,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:57:49,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:49,766 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:49,767 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:49,767 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,767 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,767 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,767 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:49,767 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:49,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:49,867 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:49,868 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:49,868 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:49,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:49,872 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:49,872 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:49,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:49,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:49,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,874 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:57:49,874 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:49,874 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 00:57:49,874 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 00:57:49,875 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,875 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:49,908 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-02-08 00:57:50,225 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:50,225 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:50,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:50,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:50,227 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:50,227 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:50,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:50,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:50,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:50,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:50,230 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:50,230 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 00:57:50,231 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:50,231 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 00:57:50,231 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:50,231 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 00:57:50,232 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:50,232 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:50,232 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:50,232 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. started... 2023-02-08 00:57:50,232 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1b4691ee9ccf8ff7c27159984cbea63d 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-08 00:57:50,652 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511289470f5484a57444a99c85f196122fe91 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511289470f5484a57444a99c85f196122fe91 2023-02-08 00:57:51,062 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/794bb6d2f0294ab0a1e9828575afb596 2023-02-08 00:57:51,074 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/794bb6d2f0294ab0a1e9828575afb596 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/794bb6d2f0294ab0a1e9828575afb596 2023-02-08 00:57:51,078 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/794bb6d2f0294ab0a1e9828575afb596, entries=1, sequenceid=9, filesize=5.0 K 2023-02-08 00:57:51,079 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 1b4691ee9ccf8ff7c27159984cbea63d in 847ms, sequenceid=9, compaction requested=false 2023-02-08 00:57:51,080 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:57:51,080 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:51,080 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:51,080 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:51,080 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,080 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 00:57:51,080 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 00:57:51,129 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,129 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:51,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:51,130 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,130 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:51,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:51,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:51,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:51,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 00:57:51,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ffd4ccc[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:51,132 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 00:57:51,133 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,194 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,194 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 00:57:51,194 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 00:57:51,194 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:51,194 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,195 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:51,213 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 00:57:51,213 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:51,213 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,214 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 00:57:51,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:51,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:51,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:51,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:51,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:51,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:51,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 00:57:51,223 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 00:57:51,223 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:51,223 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:51,223 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,223 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:51,284 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,285 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:51,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,284 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:51,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:51,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:51,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:51,286 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:51,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:51,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,288 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:51,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,561 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,561 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,561 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,561 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,561 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:51,561 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:51,561 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 00:57:51,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:57:51,562 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:51,561 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,562 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,562 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:51,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:51,561 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:51,562 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:51,562 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:51,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:51,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:51,662 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:51,663 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:51,663 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:51,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:51,668 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:51,668 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:51,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:51,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:51,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,671 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:57:51,671 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:51,671 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 00:57:51,671 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 00:57:51,671 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,671 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,742 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:51,742 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:51,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:51,743 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:51,743 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:51,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:51,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,745 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,746 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 00:57:51,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:51,746 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 00:57:51,746 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:51,746 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 00:57:51,747 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:51,747 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:51,747 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:51,747 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. started... 2023-02-08 00:57:51,747 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1b4691ee9ccf8ff7c27159984cbea63d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:52,162 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ad9078e923914d68ae887a15126151bf to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201ad9078e923914d68ae887a15126151bf 2023-02-08 00:57:52,567 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/96968b4a305e427eae6aec21ac080f73 2023-02-08 00:57:52,572 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/96968b4a305e427eae6aec21ac080f73 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/96968b4a305e427eae6aec21ac080f73 2023-02-08 00:57:52,576 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/96968b4a305e427eae6aec21ac080f73, entries=1, sequenceid=13, filesize=5.0 K 2023-02-08 00:57:52,577 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b4691ee9ccf8ff7c27159984cbea63d in 830ms, sequenceid=13, compaction requested=true 2023-02-08 00:57:52,577 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:57:52,577 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:52,577 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:52,577 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:52,577 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:52,577 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 00:57:52,577 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 00:57:53,013 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,013 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:53,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:53,015 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,015 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:53,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:53,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:53,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:53,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:53,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 00:57:53,018 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 00:57:53,018 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d4263dd[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:53,018 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,327 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,327 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 00:57:53,327 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 00:57:53,327 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:53,327 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:53,327 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:53,348 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 00:57:53,348 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:53,348 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:53,348 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 00:57:53,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:53,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:53,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:53,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:53,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:53,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:53,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:53,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:53,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:53,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 00:57:53,351 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 00:57:53,351 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:53,351 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:53,351 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,351 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:53,360 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,360 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,360 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:53,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:53,361 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:53,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,362 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:53,644 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:53,644 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:53,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:57:53,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:53,644 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:53,644 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,645 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 00:57:53,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:53,645 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:53,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:53,645 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:53,645 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:53,645 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,645 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:53,645 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:53,645 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:53,645 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,745 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:53,745 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:53,746 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:53,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:53,749 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:53,749 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:53,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:53,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:53,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,751 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:57:53,751 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:53,751 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 00:57:53,751 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 00:57:53,752 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:53,752 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:54,074 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:54,074 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:54,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:54,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:54,075 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:54,076 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:54,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:54,076 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:54,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:54,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:54,078 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:54,078 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 00:57:54,078 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:54,079 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 00:57:54,079 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:54,079 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 00:57:54,079 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:54,079 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:54,079 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:54,080 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. started... 2023-02-08 00:57:54,080 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1b4691ee9ccf8ff7c27159984cbea63d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:54,205 INFO [AsyncFSWAL-0-hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435-prefix:jenkins-hbase12.apache.org,36907,1675817727419] wal.AbstractFSWAL(1045): Slow sync cost: 124 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:45165,DS-435253a9-76ab-4295-a971-e474cccc5f92,DISK]] 2023-02-08 00:57:54,629 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053222b3ac82f04d89a01c0f4b91fb4424 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512053222b3ac82f04d89a01c0f4b91fb4424 2023-02-08 00:57:55,038 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/e85b6d0ffea14018bdb4c838c0e83e55 2023-02-08 00:57:55,049 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/e85b6d0ffea14018bdb4c838c0e83e55 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/e85b6d0ffea14018bdb4c838c0e83e55 2023-02-08 00:57:55,053 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/e85b6d0ffea14018bdb4c838c0e83e55, entries=1, sequenceid=17, filesize=5.0 K 2023-02-08 00:57:55,054 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b4691ee9ccf8ff7c27159984cbea63d in 974ms, sequenceid=17, compaction requested=true 2023-02-08 00:57:55,054 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:57:55,054 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:55,054 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:55,054 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:55,054 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,054 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 00:57:55,054 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 00:57:55,345 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,345 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:55,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:55,346 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,346 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:55,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:55,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:55,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:55,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 00:57:55,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@92e2363[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:55,348 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 00:57:55,348 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,371 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,371 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 00:57:55,371 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,371 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:55,371 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 00:57:55,371 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:55,615 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,615 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 00:57:55,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:55,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:55,616 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:55,616 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 00:57:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:55,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:55,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:55,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:55,624 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 00:57:55,624 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 00:57:55,624 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:55,624 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:55,624 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,624 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:55,653 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,653 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,653 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:55,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:55,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:55,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:55,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:55,654 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:55,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:55,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,655 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:55,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,960 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,960 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:55,961 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:55,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:57:55,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:55,960 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,961 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,961 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:55,961 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 00:57:55,961 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:55,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:55,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:55,961 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:55,961 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,962 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,962 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:55,962 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:55,963 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:55,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:56,063 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:56,063 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:56,063 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:56,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:56,068 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:56,068 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:56,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:56,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:56,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,072 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:57:56,072 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:56,072 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 00:57:56,072 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 00:57:56,073 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,073 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,336 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:56,336 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:56,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:56,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:56,337 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:56,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,337 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:56,338 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:56,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,339 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,339 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 00:57:56,339 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,339 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 00:57:56,340 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:56,340 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 00:57:56,340 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:56,340 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:56,340 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:56,341 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. started... 2023-02-08 00:57:56,341 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1b4691ee9ccf8ff7c27159984cbea63d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:56,361 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228c84dd1e6c64d4a01b481820024ddcc9d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228c84dd1e6c64d4a01b481820024ddcc9d 2023-02-08 00:57:56,774 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/8201d273d4d047ff9bd4ecf9b7eed1b6 2023-02-08 00:57:56,779 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/8201d273d4d047ff9bd4ecf9b7eed1b6 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/8201d273d4d047ff9bd4ecf9b7eed1b6 2023-02-08 00:57:56,784 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/8201d273d4d047ff9bd4ecf9b7eed1b6, entries=1, sequenceid=21, filesize=5.0 K 2023-02-08 00:57:56,785 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b4691ee9ccf8ff7c27159984cbea63d in 444ms, sequenceid=21, compaction requested=true 2023-02-08 00:57:56,785 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:57:56,785 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:56,785 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:56,785 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:56,785 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:56,785 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 00:57:56,785 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 00:57:56,886 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:56,886 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:56,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:56,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:56,887 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,887 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:56,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:56,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:56,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:56,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:56,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 00:57:56,889 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f831fe5[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:56,889 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 00:57:56,889 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,978 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,978 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 00:57:56,978 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 00:57:56,978 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:56,978 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:56,979 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:56,992 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 00:57:56,992 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:56,992 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:56,992 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 00:57:56,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:56,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:56,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:56,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:56,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:56,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:56,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:56,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:56,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:56,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 00:57:56,994 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 00:57:56,994 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:56,994 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:56,994 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:56,994 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:57,013 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,013 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:57,013 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:57,013 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:57,013 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:57,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,014 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:57,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:57,023 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:57,023 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:57,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:57,023 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:57,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:57:57,023 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:57,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:57,023 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:57,023 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,024 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,024 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:57,024 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,024 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,024 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,024 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:57,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:57,024 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:57,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:57,124 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:57,124 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:57,124 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:57,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:57,128 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:57,128 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:57,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:57,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:57,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,130 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:57:57,130 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:57,130 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 00:57:57,130 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 00:57:57,130 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,130 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,400 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:57,400 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:57,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:57,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:57,401 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:57,401 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:57,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:57,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,402 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,402 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 00:57:57,402 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:57,402 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 00:57:57,402 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:57,402 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 00:57:57,402 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:57,402 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:57,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:57,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. started... 2023-02-08 00:57:57,403 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1b4691ee9ccf8ff7c27159984cbea63d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:57,814 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231a4d57b86901e4ef592d033434ac2cffc to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a4d57b86901e4ef592d033434ac2cffc 2023-02-08 00:57:58,220 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/671a49d20ed04f7d8772e9b10becda91 2023-02-08 00:57:58,229 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/671a49d20ed04f7d8772e9b10becda91 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/671a49d20ed04f7d8772e9b10becda91 2023-02-08 00:57:58,234 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/671a49d20ed04f7d8772e9b10becda91, entries=1, sequenceid=25, filesize=5.0 K 2023-02-08 00:57:58,234 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b4691ee9ccf8ff7c27159984cbea63d in 832ms, sequenceid=25, compaction requested=true 2023-02-08 00:57:58,235 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:57:58,235 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:58,235 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:57:58,235 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:57:58,235 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,235 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 00:57:58,235 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 00:57:58,272 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,272 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:58,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:58,273 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,273 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:57:58,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:58,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:58,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:58,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 00:57:58,275 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a6db3f5[Count = 0] remaining members to acquire global barrier 2023-02-08 00:57:58,275 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 00:57:58,275 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,571 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,571 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,571 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 00:57:58,571 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 00:57:58,571 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,571 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:57:58,571 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:57:58,581 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,581 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 00:57:58,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:58,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:58,581 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:58,581 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 00:57:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:58,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:58,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:57:58,585 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 00:57:58,585 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 00:57:58,585 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:57:58,585 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:57:58,585 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,585 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:57:58,756 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,756 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,756 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:58,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:57:58,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:57:58,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:58,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:58,758 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:57:58,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:57:58,759 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:57:58,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,841 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,841 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,841 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:57:58,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:57:58,841 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:58,841 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:58,841 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:57:58,842 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,842 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 00:57:58,842 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:57:58,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:58,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:58,842 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:57:58,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 00:57:58,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:57:58,842 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:57:58,843 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,942 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:57:58,943 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:58,943 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:58,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:57:58,946 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:57:58,947 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:57:58,947 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:57:58,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 00:57:58,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,949 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:57:58,949 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:58,949 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 00:57:58,949 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 00:57:58,949 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:58,949 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:59,213 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:57:59,213 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:59,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:57:59,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:57:59,215 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:57:59,215 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:57:59,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:59,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:59,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:57:59,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:59,218 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:59,219 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 00:57:59,219 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:57:59,219 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 00:57:59,219 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:57:59,219 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 00:57:59,220 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:57:59,220 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:57:59,220 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:57:59,220 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. started... 2023-02-08 00:57:59,220 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1b4691ee9ccf8ff7c27159984cbea63d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:57:59,641 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101e09327cfab934feea4afd6bf7bbf1d4c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101e09327cfab934feea4afd6bf7bbf1d4c 2023-02-08 00:58:00,048 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/725c38de6ee547b3b822216ad82d50ad 2023-02-08 00:58:00,053 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/725c38de6ee547b3b822216ad82d50ad as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/725c38de6ee547b3b822216ad82d50ad 2023-02-08 00:58:00,057 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/725c38de6ee547b3b822216ad82d50ad, entries=1, sequenceid=29, filesize=5.0 K 2023-02-08 00:58:00,058 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b4691ee9ccf8ff7c27159984cbea63d in 838ms, sequenceid=29, compaction requested=true 2023-02-08 00:58:00,058 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:58:00,058 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:00,058 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:58:00,058 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:58:00,058 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,058 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 00:58:00,058 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 00:58:00,128 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,128 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:00,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:00,128 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,128 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:58:00,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:00,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:00,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:00,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 00:58:00,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64ff71ee[Count = 0] remaining members to acquire global barrier 2023-02-08 00:58:00,130 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 00:58:00,130 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,219 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,220 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 00:58:00,220 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 00:58:00,220 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:58:00,220 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,220 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:58:00,508 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 00:58:00,508 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:00,508 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,509 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 00:58:00,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:00,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:00,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:00,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:00,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:00,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:58:00,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 00:58:00,517 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 00:58:00,517 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:58:00,517 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:58:00,517 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,517 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:58:00,549 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,549 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:00,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,549 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:00,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:00,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:00,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:00,550 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:00,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:00,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,551 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:00,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,574 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,574 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:00,574 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:58:00,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:58:00,574 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,574 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:00,574 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:00,575 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 00:58:00,575 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 00:58:00,574 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:00,575 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:58:00,575 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:00,575 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:00,576 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,576 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,675 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:58:00,676 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:00,676 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:00,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:58:00,681 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:00,681 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:00,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:58:00,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 00:58:00,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,685 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:58:00,686 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:00,686 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 00:58:00,686 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 00:58:00,686 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,686 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,968 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:00,968 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:00,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:00,969 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:00,969 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:58:00,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:58:00,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,971 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,971 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 00:58:00,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:00,971 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 00:58:00,971 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:00,972 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 00:58:00,972 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:58:00,972 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:58:00,972 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:00,972 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. started... 2023-02-08 00:58:00,972 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1b4691ee9ccf8ff7c27159984cbea63d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:58:01,388 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035278307893c74cd6a33364c083114f97 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601035278307893c74cd6a33364c083114f97 2023-02-08 00:58:01,798 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/27f5afa603454d6db0517616b30833ff 2023-02-08 00:58:01,807 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/27f5afa603454d6db0517616b30833ff as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/27f5afa603454d6db0517616b30833ff 2023-02-08 00:58:01,811 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/27f5afa603454d6db0517616b30833ff, entries=1, sequenceid=33, filesize=5.0 K 2023-02-08 00:58:01,812 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b4691ee9ccf8ff7c27159984cbea63d in 840ms, sequenceid=33, compaction requested=true 2023-02-08 00:58:01,812 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:58:01,812 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:01,812 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:58:01,812 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:58:01,812 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:01,812 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 00:58:01,812 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 00:58:02,083 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:02,083 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:02,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:02,084 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,084 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:58:02,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:02,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:02,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:02,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 00:58:02,088 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c327329[Count = 0] remaining members to acquire global barrier 2023-02-08 00:58:02,088 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 00:58:02,088 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,103 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,104 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 00:58:02,104 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 00:58:02,104 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:02,104 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:58:02,104 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:58:02,379 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 00:58:02,379 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:02,379 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 00:58:02,379 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:02,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:02,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:02,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:02,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:02,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:02,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:02,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:02,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:02,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:58:02,382 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 00:58:02,382 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 00:58:02,382 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:58:02,382 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:58:02,382 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,382 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:58:02,402 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,402 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:02,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,402 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:02,402 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:02,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:02,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,403 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:02,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:02,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:02,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:02,736 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:02,736 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,736 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,736 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:02,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:58:02,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:58:02,736 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:02,736 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 00:58:02,736 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,736 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:02,737 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 00:58:02,737 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:58:02,737 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,737 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:02,737 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:02,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:02,738 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:02,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:02,837 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:58:02,838 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:02,838 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:02,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:58:02,842 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:02,842 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:02,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:58:02,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 00:58:02,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,844 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:58:02,844 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:02,844 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 00:58:02,844 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 00:58:02,845 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:02,845 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:03,114 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:03,114 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:03,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:03,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:03,116 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:03,116 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:58:03,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:03,117 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:03,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:58:03,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:03,118 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:03,119 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 00:58:03,119 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:03,119 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 00:58:03,119 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:03,119 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 00:58:03,120 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:58:03,120 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:58:03,120 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:03,120 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. started... 2023-02-08 00:58:03,120 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1b4691ee9ccf8ff7c27159984cbea63d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:58:03,538 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015090795b5bc7d5d0243d2b819679e12cfd8c1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015090795b5bc7d5d0243d2b819679e12cfd8c1 2023-02-08 00:58:03,944 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/4d43bbf8bd0b4f17998fcd2f6728467e 2023-02-08 00:58:03,948 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/4d43bbf8bd0b4f17998fcd2f6728467e as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/4d43bbf8bd0b4f17998fcd2f6728467e 2023-02-08 00:58:03,951 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/4d43bbf8bd0b4f17998fcd2f6728467e, entries=1, sequenceid=37, filesize=5.0 K 2023-02-08 00:58:03,952 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b4691ee9ccf8ff7c27159984cbea63d in 832ms, sequenceid=37, compaction requested=true 2023-02-08 00:58:03,952 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:58:03,952 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:03,952 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:58:03,952 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:58:03,952 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:03,952 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 00:58:03,952 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 00:58:04,181 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:04,181 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:04,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:04,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:04,181 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:04,181 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:58:04,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:04,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:04,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:04,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 00:58:04,183 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5b892b7d[Count = 0] remaining members to acquire global barrier 2023-02-08 00:58:04,183 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 00:58:04,183 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,246 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,246 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 00:58:04,247 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 00:58:04,247 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:58:04,247 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:04,247 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:58:04,318 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:04,318 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 00:58:04,318 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:04,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:04,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:04,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:04,318 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 00:58:04,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:04,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:04,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:04,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:04,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:04,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:58:04,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 00:58:04,326 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 00:58:04,326 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:58:04,326 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:58:04,327 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,327 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:58:04,616 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,616 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:04,616 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:04,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:04,617 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:04,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:04,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,617 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:04,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:04,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:04,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:04,662 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:04,662 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:04,663 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:04,663 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 00:58:04,662 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:58:04,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:58:04,663 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:04,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:04,663 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:04,663 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,664 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 00:58:04,664 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:58:04,664 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:04,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:04,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:04,664 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,665 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,665 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,764 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:58:04,765 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:04,765 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:04,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:58:04,771 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:04,771 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:04,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:58:04,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-02-08 00:58:04,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,775 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:58:04,775 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:04,775 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-02-08 00:58:04,775 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-02-08 00:58:04,776 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:04,776 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:05,012 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:05,012 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:05,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:05,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:05,013 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:05,013 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:58:05,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:05,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:05,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:58:05,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:05,015 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:05,015 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-02-08 00:58:05,015 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:05,015 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-02-08 00:58:05,016 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:05,016 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-02-08 00:58:05,016 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:58:05,016 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:58:05,016 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:05,016 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. started... 2023-02-08 00:58:05,016 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 1b4691ee9ccf8ff7c27159984cbea63d 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:58:05,501 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511207ac2e5d392414ebb8b3c8e97ef24b212 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207ac2e5d392414ebb8b3c8e97ef24b212 2023-02-08 00:58:05,907 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/90c06c08227e4db3b6c2d1619fadf548 2023-02-08 00:58:05,914 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/90c06c08227e4db3b6c2d1619fadf548 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/90c06c08227e4db3b6c2d1619fadf548 2023-02-08 00:58:05,921 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/90c06c08227e4db3b6c2d1619fadf548, entries=1, sequenceid=41, filesize=5.0 K 2023-02-08 00:58:05,922 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 1b4691ee9ccf8ff7c27159984cbea63d in 906ms, sequenceid=41, compaction requested=true 2023-02-08 00:58:05,922 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:58:05,922 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:05,922 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:58:05,922 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:58:05,922 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:05,922 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-02-08 00:58:05,922 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-02-08 00:58:06,080 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:06,080 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:06,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:06,081 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:06,081 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:58:06,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:06,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:06,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:06,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-02-08 00:58:06,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1cbcc9e2[Count = 0] remaining members to acquire global barrier 2023-02-08 00:58:06,085 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-02-08 00:58:06,085 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,194 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,195 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-02-08 00:58:06,195 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-02-08 00:58:06,195 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:58:06,195 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:06,195 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:58:06,244 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:06,244 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-02-08 00:58:06,244 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:06,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:06,244 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-02-08 00:58:06,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:06,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:06,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:06,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:06,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:06,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:06,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:06,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:58:06,249 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-02-08 00:58:06,250 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-02-08 00:58:06,250 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:58:06,250 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:58:06,250 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,250 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:58:06,278 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,278 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:06,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:06,278 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:06,279 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:06,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:06,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:06,279 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:06,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:06,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,280 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:06,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:06,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:06,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:06,602 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:06,602 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:06,602 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:06,603 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-02-08 00:58:06,602 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,603 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,603 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:06,603 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,603 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,603 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:06,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-02-08 00:58:06,603 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:58:06,602 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:06,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:06,604 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-02-08 00:58:06,604 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:58:06,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:06,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:06,704 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:58:06,704 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:06,705 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:06,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:58:06,709 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:06,712 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 00:58:06,713 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 00:58:06,714 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:58:06,714 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818486714 2023-02-08 00:58:06,717 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 00:58:06,718 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-08 00:58:06,718 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 00:58:06,719 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x362457bf to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:58:06,760 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6dfc2ed0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:58:06,761 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:07,216 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010355dcc28e8c4d4db7a5d642c9cfc68e8b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2016010355dcc28e8c4d4db7a5d642c9cfc68e8b 2023-02-08 00:58:07,217 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 00:58:07,237 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:58:07,238 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:45290, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:58:07,244 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:07,244 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:07,245 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:58:07,246 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:57412, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:58:07,255 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/54df8266750249368d523cf211d568be first=Optional[r3] last=Optional[r6] 2023-02-08 00:58:07,256 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/54df8266750249368d523cf211d568be}] 2023-02-08 00:58:07,260 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/54df8266750249368d523cf211d568be for inclusion in 1b4691ee9ccf8ff7c27159984cbea63d/family1 2023-02-08 00:58:07,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-02-08 00:58:07,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:58:07,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:58:07,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/54df8266750249368d523cf211d568be to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gobrk58om3knjglmgpgf5tb6gjkmsf15qgqtmkaai8fcpnlnj94m74sha2c9vel/family1/54df8266750249368d523cf211d568be 2023-02-08 00:58:07,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gobrk58om3knjglmgpgf5tb6gjkmsf15qgqtmkaai8fcpnlnj94m74sha2c9vel/family1/54df8266750249368d523cf211d568be as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/b8a8e5e9759748ed883afdbceaca987d_SeqId_44_ 2023-02-08 00:58:07,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gobrk58om3knjglmgpgf5tb6gjkmsf15qgqtmkaai8fcpnlnj94m74sha2c9vel/family1/54df8266750249368d523cf211d568be into 1b4691ee9ccf8ff7c27159984cbea63d/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/b8a8e5e9759748ed883afdbceaca987d_SeqId_44_ - updating store file list. 2023-02-08 00:58:07,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/b8a8e5e9759748ed883afdbceaca987d_SeqId_44_ into 1b4691ee9ccf8ff7c27159984cbea63d/family1 2023-02-08 00:58:07,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gobrk58om3knjglmgpgf5tb6gjkmsf15qgqtmkaai8fcpnlnj94m74sha2c9vel/family1/54df8266750249368d523cf211d568be into 1b4691ee9ccf8ff7c27159984cbea63d/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/b8a8e5e9759748ed883afdbceaca987d_SeqId_44_) 2023-02-08 00:58:07,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__gobrk58om3knjglmgpgf5tb6gjkmsf15qgqtmkaai8fcpnlnj94m74sha2c9vel/family1/54df8266750249368d523cf211d568be 2023-02-08 00:58:07,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-08 00:58:07,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-08 00:58:07,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 1b4691ee9ccf8ff7c27159984cbea63d/family1 is initiating minor compaction 2023-02-08 00:58:07,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@6d049a08; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:58:07,279 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 1b4691ee9ccf8ff7c27159984cbea63d/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:07,279 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/794bb6d2f0294ab0a1e9828575afb596, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/96968b4a305e427eae6aec21ac080f73, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/e85b6d0ffea14018bdb4c838c0e83e55, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/8201d273d4d047ff9bd4ecf9b7eed1b6, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/671a49d20ed04f7d8772e9b10becda91, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/725c38de6ee547b3b822216ad82d50ad, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/27f5afa603454d6db0517616b30833ff, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/4d43bbf8bd0b4f17998fcd2f6728467e, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/90c06c08227e4db3b6c2d1619fadf548, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/b8a8e5e9759748ed883afdbceaca987d_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp, totalSize=50.3 K 2023-02-08 00:58:07,279 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 794bb6d2f0294ab0a1e9828575afb596, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 00:58:07,279 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 96968b4a305e427eae6aec21ac080f73, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 00:58:07,279 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting e85b6d0ffea14018bdb4c838c0e83e55, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-08 00:58:07,280 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 8201d273d4d047ff9bd4ecf9b7eed1b6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-08 00:58:07,280 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 671a49d20ed04f7d8772e9b10becda91, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-08 00:58:07,280 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 725c38de6ee547b3b822216ad82d50ad, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-08 00:58:07,280 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 27f5afa603454d6db0517616b30833ff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-08 00:58:07,280 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 4d43bbf8bd0b4f17998fcd2f6728467e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-08 00:58:07,280 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 90c06c08227e4db3b6c2d1619fadf548, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-08 00:58:07,280 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting b8a8e5e9759748ed883afdbceaca987d_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-08 00:58:07,281 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 00:58:07,282 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:07,283 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228c84dd1e6c64d4a01b481820024ddcc9d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151228c84dd1e6c64d4a01b481820024ddcc9d 2023-02-08 00:58:07,284 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a4d57b86901e4ef592d033434ac2cffc to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231a4d57b86901e4ef592d033434ac2cffc 2023-02-08 00:58:07,285 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101e09327cfab934feea4afd6bf7bbf1d4c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101e09327cfab934feea4afd6bf7bbf1d4c 2023-02-08 00:58:07,287 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601035278307893c74cd6a33364c083114f97 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601035278307893c74cd6a33364c083114f97 2023-02-08 00:58:07,287 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-02-08 00:58:07,287 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-02-08 00:58:07,287 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:07,287 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:07,287 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:07,287 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:07,287 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:07,287 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:07,288 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:07,288 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:07,316 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1b4691ee9ccf8ff7c27159984cbea63d#family1#compaction#73 average throughput is 1.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-08 00:58:07,746 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x431fee1f to 127.0.0.1:49726 2023-02-08 00:58:07,747 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:58:07,747 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:58:07,747 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77aa3f47 to 127.0.0.1:49726 2023-02-08 00:58:07,747 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:58:07,747 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:58:07,747 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4eecd31b to 127.0.0.1:49726 2023-02-08 00:58:07,747 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:58:07,747 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:58:07,747 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11d59297 to 127.0.0.1:49726 2023-02-08 00:58:07,747 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:58:08,155 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055e97b262a18e4050b59362f5602b2325 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512055e97b262a18e4050b59362f5602b2325 2023-02-08 00:58:08,156 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/e73e1769f9d54e0881202dbcd380f166 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/e73e1769f9d54e0881202dbcd380f166 2023-02-08 00:58:08,157 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 00:58:08,163 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 1b4691ee9ccf8ff7c27159984cbea63d/family1 of 1b4691ee9ccf8ff7c27159984cbea63d into e73e1769f9d54e0881202dbcd380f166(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:58:08,163 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:58:08,163 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1675817887278; duration=0sec 2023-02-08 00:58:08,163 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:58:08,173 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:08,173 INFO [MobCompactor-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:08,180 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9e7e80c40a904d8aa8ddcc6c97e28495 first=Optional[r00] last=Optional[r2] 2023-02-08 00:58:08,181 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9e7e80c40a904d8aa8ddcc6c97e28495}] 2023-02-08 00:58:08,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9e7e80c40a904d8aa8ddcc6c97e28495 for inclusion in 1b4691ee9ccf8ff7c27159984cbea63d/family1 2023-02-08 00:58:08,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-02-08 00:58:08,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:58:08,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:58:08,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/9e7e80c40a904d8aa8ddcc6c97e28495 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dbq6sf7u10op75n43e6vvaicda6qlh125kl3220bjl0biakdrcfc8g2m1415lusm/family1/9e7e80c40a904d8aa8ddcc6c97e28495 2023-02-08 00:58:08,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dbq6sf7u10op75n43e6vvaicda6qlh125kl3220bjl0biakdrcfc8g2m1415lusm/family1/9e7e80c40a904d8aa8ddcc6c97e28495 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/5dd9ac28e9234dbaae28dc71c74b5ef4_SeqId_47_ 2023-02-08 00:58:08,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dbq6sf7u10op75n43e6vvaicda6qlh125kl3220bjl0biakdrcfc8g2m1415lusm/family1/9e7e80c40a904d8aa8ddcc6c97e28495 into 1b4691ee9ccf8ff7c27159984cbea63d/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/5dd9ac28e9234dbaae28dc71c74b5ef4_SeqId_47_ - updating store file list. 2023-02-08 00:58:08,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/5dd9ac28e9234dbaae28dc71c74b5ef4_SeqId_47_ into 1b4691ee9ccf8ff7c27159984cbea63d/family1 2023-02-08 00:58:08,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dbq6sf7u10op75n43e6vvaicda6qlh125kl3220bjl0biakdrcfc8g2m1415lusm/family1/9e7e80c40a904d8aa8ddcc6c97e28495 into 1b4691ee9ccf8ff7c27159984cbea63d/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/5dd9ac28e9234dbaae28dc71c74b5ef4_SeqId_47_) 2023-02-08 00:58:08,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__dbq6sf7u10op75n43e6vvaicda6qlh125kl3220bjl0biakdrcfc8g2m1415lusm/family1/9e7e80c40a904d8aa8ddcc6c97e28495 2023-02-08 00:58:08,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 00:58:08,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 00:58:08,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): 1b4691ee9ccf8ff7c27159984cbea63d/family1 is initiating minor compaction (all files) 2023-02-08 00:58:08,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@32061519; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:58:08,196 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 1b4691ee9ccf8ff7c27159984cbea63d/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:08,196 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/ddf1775511624c8cafb04572cd993d12, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/e73e1769f9d54e0881202dbcd380f166, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/5dd9ac28e9234dbaae28dc71c74b5ef4_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp, totalSize=388.1 K 2023-02-08 00:58:08,196 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting ddf1775511624c8cafb04572cd993d12, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878836759 2023-02-08 00:58:08,197 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting e73e1769f9d54e0881202dbcd380f166, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621236759 2023-02-08 00:58:08,197 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 5dd9ac28e9234dbaae28dc71c74b5ef4_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878836759 2023-02-08 00:58:08,197 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 00:58:08,198 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:08,199 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e471c5f0b4884d78a67b5ed04fca4092 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151130e471c5f0b4884d78a67b5ed04fca4092 2023-02-08 00:58:08,200 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201ad9078e923914d68ae887a15126151bf to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201ad9078e923914d68ae887a15126151bf 2023-02-08 00:58:08,201 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512053222b3ac82f04d89a01c0f4b91fb4424 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512053222b3ac82f04d89a01c0f4b91fb4424 2023-02-08 00:58:08,201 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-02-08 00:58:08,201 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-02-08 00:58:08,202 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:08,202 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 00:58:08,202 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:58:08,203 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 00:58:08,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4930 sec 2023-02-08 00:58:08,210 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 1b4691ee9ccf8ff7c27159984cbea63d#family1#compaction#74 average throughput is 35.93 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-08 00:58:08,233 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/794bb6d2f0294ab0a1e9828575afb596, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/96968b4a305e427eae6aec21ac080f73, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/e85b6d0ffea14018bdb4c838c0e83e55, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/8201d273d4d047ff9bd4ecf9b7eed1b6, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/671a49d20ed04f7d8772e9b10becda91, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/725c38de6ee547b3b822216ad82d50ad, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/27f5afa603454d6db0517616b30833ff, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/4d43bbf8bd0b4f17998fcd2f6728467e, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/90c06c08227e4db3b6c2d1619fadf548, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/b8a8e5e9759748ed883afdbceaca987d_SeqId_44_] to archive 2023-02-08 00:58:08,234 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:08,236 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/794bb6d2f0294ab0a1e9828575afb596 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/794bb6d2f0294ab0a1e9828575afb596 2023-02-08 00:58:08,238 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/96968b4a305e427eae6aec21ac080f73 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/96968b4a305e427eae6aec21ac080f73 2023-02-08 00:58:08,239 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/e85b6d0ffea14018bdb4c838c0e83e55 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/e85b6d0ffea14018bdb4c838c0e83e55 2023-02-08 00:58:08,240 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/8201d273d4d047ff9bd4ecf9b7eed1b6 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/8201d273d4d047ff9bd4ecf9b7eed1b6 2023-02-08 00:58:08,241 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/671a49d20ed04f7d8772e9b10becda91 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/671a49d20ed04f7d8772e9b10becda91 2023-02-08 00:58:08,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/725c38de6ee547b3b822216ad82d50ad to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/725c38de6ee547b3b822216ad82d50ad 2023-02-08 00:58:08,242 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/27f5afa603454d6db0517616b30833ff to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/27f5afa603454d6db0517616b30833ff 2023-02-08 00:58:08,243 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/4d43bbf8bd0b4f17998fcd2f6728467e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/4d43bbf8bd0b4f17998fcd2f6728467e 2023-02-08 00:58:08,244 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/90c06c08227e4db3b6c2d1619fadf548 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/90c06c08227e4db3b6c2d1619fadf548 2023-02-08 00:58:08,245 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/b8a8e5e9759748ed883afdbceaca987d_SeqId_44_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/b8a8e5e9759748ed883afdbceaca987d_SeqId_44_ 2023-02-08 00:58:08,274 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:08,274 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:08,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-08 00:58:08,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:08,684 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-08 00:58:08,685 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-02-08 00:58:08,685 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-08 00:58:08,686 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-08 00:58:08,688 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1b4691ee9ccf8ff7c27159984cbea63d, REOPEN/MOVE}] 2023-02-08 00:58:08,689 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1b4691ee9ccf8ff7c27159984cbea63d, REOPEN/MOVE 2023-02-08 00:58:08,690 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=1b4691ee9ccf8ff7c27159984cbea63d, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:08,690 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675817888690"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817888690"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817888690"}]},"ts":"1675817888690"} 2023-02-08 00:58:08,691 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 1b4691ee9ccf8ff7c27159984cbea63d, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:08,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:08,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 1b4691ee9ccf8ff7c27159984cbea63d, disabling compactions & flushes 2023-02-08 00:58:08,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1857): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:09,035 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/.tmp/family1/08bcf49f90064b589f14c3a59e17bcb5 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/08bcf49f90064b589f14c3a59e17bcb5 2023-02-08 00:58:09,041 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 1b4691ee9ccf8ff7c27159984cbea63d/family1 of 1b4691ee9ccf8ff7c27159984cbea63d into 08bcf49f90064b589f14c3a59e17bcb5(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:58:09,041 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:58:09,041 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:09,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:09,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. after waiting 0 ms 2023-02-08 00:58:09,041 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:09,041 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1675817888196; duration=0sec 2023-02-08 00:58:09,041 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:58:09,044 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/ddf1775511624c8cafb04572cd993d12, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/e73e1769f9d54e0881202dbcd380f166, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/5dd9ac28e9234dbaae28dc71c74b5ef4_SeqId_47_] to archive 2023-02-08 00:58:09,045 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:09,047 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/ddf1775511624c8cafb04572cd993d12 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/ddf1775511624c8cafb04572cd993d12 2023-02-08 00:58:09,048 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/e73e1769f9d54e0881202dbcd380f166 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/e73e1769f9d54e0881202dbcd380f166 2023-02-08 00:58:09,050 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/5dd9ac28e9234dbaae28dc71c74b5ef4_SeqId_47_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/5dd9ac28e9234dbaae28dc71c74b5ef4_SeqId_47_ 2023-02-08 00:58:09,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-08 00:58:09,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:09,057 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 1b4691ee9ccf8ff7c27159984cbea63d: Waiting for close lock at 1675817888843Running coprocessor pre-close hooks at 1675817888843Disabling compacts and flushes for region at 1675817888843Disabling writes for close at 1675817889041 (+198 ms)Writing region close event to WAL at 1675817889053 (+12 ms)Running coprocessor post-close hooks at 1675817889057 (+4 ms)Closed at 1675817889057 2023-02-08 00:58:09,057 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 1b4691ee9ccf8ff7c27159984cbea63d to self. 2023-02-08 00:58:09,059 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:09,059 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=1b4691ee9ccf8ff7c27159984cbea63d, regionState=CLOSED 2023-02-08 00:58:09,059 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675817889059"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817889059"}]},"ts":"1675817889059"} 2023-02-08 00:58:09,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=62, resume processing ppid=61 2023-02-08 00:58:09,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 1b4691ee9ccf8ff7c27159984cbea63d, server=jenkins-hbase12.apache.org,36907,1675817727419 in 369 msec 2023-02-08 00:58:09,061 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1b4691ee9ccf8ff7c27159984cbea63d, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=true 2023-02-08 00:58:09,212 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=1b4691ee9ccf8ff7c27159984cbea63d, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:09,212 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675817889212"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817889212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817889212"}]},"ts":"1675817889212"} 2023-02-08 00:58:09,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 1b4691ee9ccf8ff7c27159984cbea63d, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:09,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:09,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1b4691ee9ccf8ff7c27159984cbea63d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:58:09,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:09,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:09,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:09,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:09,380 INFO [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:09,382 DEBUG [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1 2023-02-08 00:58:09,382 DEBUG [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1 2023-02-08 00:58:09,382 INFO [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b4691ee9ccf8ff7c27159984cbea63d columnFamilyName family1 2023-02-08 00:58:09,389 DEBUG [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/08bcf49f90064b589f14c3a59e17bcb5 2023-02-08 00:58:09,390 INFO [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] regionserver.HStore(310): Store=1b4691ee9ccf8ff7c27159984cbea63d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:09,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:09,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:09,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:09,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 1b4691ee9ccf8ff7c27159984cbea63d; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71691514, jitterRate=0.06828680634498596}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:58:09,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 1b4691ee9ccf8ff7c27159984cbea63d: Running coprocessor pre-open hook at 1675817889378Writing region info on filesystem at 1675817889378Initializing all the Stores at 1675817889380 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675817889380Cleaning up temporary data from old regions at 1675817889393 (+13 ms)Cleaning up detritus from prior splits at 1675817889394 (+1 ms)Running coprocessor post-open hooks at 1675817889399 (+5 ms)Region opened successfully at 1675817889399 2023-02-08 00:58:09,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d., pid=63, masterSystemTime=1675817889371 2023-02-08 00:58:09,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:09,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:09,402 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=1b4691ee9ccf8ff7c27159984cbea63d, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:09,403 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675817889402"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817889402"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817889402"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817889402"}]},"ts":"1675817889402"} 2023-02-08 00:58:09,407 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=63, resume processing ppid=61 2023-02-08 00:58:09,407 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 1b4691ee9ccf8ff7c27159984cbea63d, server=jenkins-hbase12.apache.org,36907,1675817727419 in 189 msec 2023-02-08 00:58:09,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=60 2023-02-08 00:58:09,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1b4691ee9ccf8ff7c27159984cbea63d, REOPEN/MOVE in 719 msec 2023-02-08 00:58:09,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=59 2023-02-08 00:58:09,412 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 724 msec 2023-02-08 00:58:09,415 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1380 sec 2023-02-08 00:58:09,415 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:09,415 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:09,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=59 2023-02-08 00:58:09,416 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:09,416 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:09,416 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:09,416 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:09,417 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(278): alter status finished 2023-02-08 00:58:09,418 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:09,419 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 00:58:09,419 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 00:58:09,420 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:58:09,420 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818489420 2023-02-08 00:58:09,420 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 00:58:09,421 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-08 00:58:09,421 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 00:58:09,421 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x03bfbd7b to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:58:09,529 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@52c6377a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:58:09,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:09,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:09,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:09,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:09,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:10,366 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e61b712f66724a7cb8863b9bd909ce7e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128e61b712f66724a7cb8863b9bd909ce7e 2023-02-08 00:58:10,367 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 00:58:10,382 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:58:10,382 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:45292, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:58:10,387 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:10,387 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:10,388 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:58:10,390 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:57428, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:58:10,400 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a4bf3544d8ba413488bacb6e2713fceb first=Optional[r05] last=Optional[r8] 2023-02-08 00:58:10,400 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=51 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a4bf3544d8ba413488bacb6e2713fceb}] 2023-02-08 00:58:10,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a4bf3544d8ba413488bacb6e2713fceb for inclusion in 1b4691ee9ccf8ff7c27159984cbea63d/family1 2023-02-08 00:58:10,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-02-08 00:58:10,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:58:10,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 1b4691ee9ccf8ff7c27159984cbea63d: 2023-02-08 00:58:10,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a4bf3544d8ba413488bacb6e2713fceb to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v7oe15afhoshmanu0b86a3sa7dealqe4t3g8uvfsq1e7jlvfi992otno9cnm9hnq/family1/a4bf3544d8ba413488bacb6e2713fceb 2023-02-08 00:58:10,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v7oe15afhoshmanu0b86a3sa7dealqe4t3g8uvfsq1e7jlvfi992otno9cnm9hnq/family1/a4bf3544d8ba413488bacb6e2713fceb as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/c4842a3dac1b477b8d9ac5b09faf01a4_SeqId_53_ 2023-02-08 00:58:10,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v7oe15afhoshmanu0b86a3sa7dealqe4t3g8uvfsq1e7jlvfi992otno9cnm9hnq/family1/a4bf3544d8ba413488bacb6e2713fceb into 1b4691ee9ccf8ff7c27159984cbea63d/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/c4842a3dac1b477b8d9ac5b09faf01a4_SeqId_53_ - updating store file list. 2023-02-08 00:58:10,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/c4842a3dac1b477b8d9ac5b09faf01a4_SeqId_53_ into 1b4691ee9ccf8ff7c27159984cbea63d/family1 2023-02-08 00:58:10,418 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v7oe15afhoshmanu0b86a3sa7dealqe4t3g8uvfsq1e7jlvfi992otno9cnm9hnq/family1/a4bf3544d8ba413488bacb6e2713fceb into 1b4691ee9ccf8ff7c27159984cbea63d/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/c4842a3dac1b477b8d9ac5b09faf01a4_SeqId_53_) 2023-02-08 00:58:10,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__v7oe15afhoshmanu0b86a3sa7dealqe4t3g8uvfsq1e7jlvfi992otno9cnm9hnq/family1/a4bf3544d8ba413488bacb6e2713fceb 2023-02-08 00:58:10,420 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 00:58:10,421 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:10,422 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207ac2e5d392414ebb8b3c8e97ef24b212 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511207ac2e5d392414ebb8b3c8e97ef24b212 2023-02-08 00:58:10,422 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511289470f5484a57444a99c85f196122fe91 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511289470f5484a57444a99c85f196122fe91 2023-02-08 00:58:10,422 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-02-08 00:58:10,423 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-08 00:58:10,423 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:10,423 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:10,423 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:10,423 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 00:58:10,423 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:58:10,424 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 00:58:10,425 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.0060 sec 2023-02-08 00:58:10,482 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:10,482 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:10,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$12(2441): Client=jenkins//136.243.104.168 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-02-08 00:58:10,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:10,893 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-08 00:58:10,894 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-02-08 00:58:10,894 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-02-08 00:58:10,896 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-02-08 00:58:10,899 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1b4691ee9ccf8ff7c27159984cbea63d, REOPEN/MOVE}] 2023-02-08 00:58:10,900 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1b4691ee9ccf8ff7c27159984cbea63d, REOPEN/MOVE 2023-02-08 00:58:10,900 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1b4691ee9ccf8ff7c27159984cbea63d, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:10,901 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675817890900"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817890900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817890900"}]},"ts":"1675817890900"} 2023-02-08 00:58:10,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 1b4691ee9ccf8ff7c27159984cbea63d, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:11,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:11,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 1b4691ee9ccf8ff7c27159984cbea63d, disabling compactions & flushes 2023-02-08 00:58:11,055 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:11,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:11,055 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. after waiting 0 ms 2023-02-08 00:58:11,056 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:11,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-08 00:58:11,069 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:11,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 1b4691ee9ccf8ff7c27159984cbea63d: Waiting for close lock at 1675817891055Running coprocessor pre-close hooks at 1675817891055Disabling compacts and flushes for region at 1675817891055Disabling writes for close at 1675817891056 (+1 ms)Writing region close event to WAL at 1675817891061 (+5 ms)Running coprocessor post-close hooks at 1675817891069 (+8 ms)Closed at 1675817891069 2023-02-08 00:58:11,069 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(3509): Not adding moved region record: 1b4691ee9ccf8ff7c27159984cbea63d to self. 2023-02-08 00:58:11,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:11,072 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1b4691ee9ccf8ff7c27159984cbea63d, regionState=CLOSED 2023-02-08 00:58:11,073 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675817891072"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817891072"}]},"ts":"1675817891072"} 2023-02-08 00:58:11,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=67 2023-02-08 00:58:11,077 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 1b4691ee9ccf8ff7c27159984cbea63d, server=jenkins-hbase12.apache.org,36907,1675817727419 in 172 msec 2023-02-08 00:58:11,077 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1b4691ee9ccf8ff7c27159984cbea63d, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=true 2023-02-08 00:58:11,228 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1b4691ee9ccf8ff7c27159984cbea63d, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:11,229 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675817891228"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817891228"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817891228"}]},"ts":"1675817891228"} 2023-02-08 00:58:11,233 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 1b4691ee9ccf8ff7c27159984cbea63d, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:11,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:11,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 1b4691ee9ccf8ff7c27159984cbea63d, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:58:11,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:11,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:11,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:11,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:11,395 INFO [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:11,396 DEBUG [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1 2023-02-08 00:58:11,396 DEBUG [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1 2023-02-08 00:58:11,397 INFO [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b4691ee9ccf8ff7c27159984cbea63d columnFamilyName family1 2023-02-08 00:58:11,403 DEBUG [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/08bcf49f90064b589f14c3a59e17bcb5 2023-02-08 00:58:11,408 DEBUG [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/family1/c4842a3dac1b477b8d9ac5b09faf01a4_SeqId_53_ 2023-02-08 00:58:11,408 INFO [StoreOpener-1b4691ee9ccf8ff7c27159984cbea63d-1] regionserver.HStore(310): Store=1b4691ee9ccf8ff7c27159984cbea63d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:11,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:11,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:11,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 00:58:11,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 1b4691ee9ccf8ff7c27159984cbea63d; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61281760, jitterRate=-0.08683061599731445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:58:11,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 1b4691ee9ccf8ff7c27159984cbea63d: Running coprocessor pre-open hook at 1675817891394Writing region info on filesystem at 1675817891394Initializing all the Stores at 1675817891395 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} at 1675817891395Cleaning up temporary data from old regions at 1675817891410 (+15 ms)Cleaning up detritus from prior splits at 1675817891411 (+1 ms)Running coprocessor post-open hooks at 1675817891413 (+2 ms)Region opened successfully at 1675817891413 2023-02-08 00:58:11,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d., pid=69, masterSystemTime=1675817891387 2023-02-08 00:58:11,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:11,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 00:58:11,416 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=1b4691ee9ccf8ff7c27159984cbea63d, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:11,416 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1675817891416"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817891416"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817891416"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817891416"}]},"ts":"1675817891416"} 2023-02-08 00:58:11,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=67 2023-02-08 00:58:11,419 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 1b4691ee9ccf8ff7c27159984cbea63d, server=jenkins-hbase12.apache.org,36907,1675817727419 in 184 msec 2023-02-08 00:58:11,422 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-02-08 00:58:11,422 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=1b4691ee9ccf8ff7c27159984cbea63d, REOPEN/MOVE in 520 msec 2023-02-08 00:58:11,424 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=66, resume processing ppid=65 2023-02-08 00:58:11,424 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 527 msec 2023-02-08 00:58:11,427 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 942 msec 2023-02-08 00:58:11,428 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:11,428 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:11,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=65 2023-02-08 00:58:11,428 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:11,429 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:11,429 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:11,429 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:11,429 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(278): alter status finished 2023-02-08 00:58:11,430 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-02-08 00:58:11,431 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 00:58:11,432 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 00:58:11,432 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:58:11,432 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818491432 2023-02-08 00:58:11,433 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 00:58:11,433 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-02-08 00:58:11,433 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 00:58:11,434 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x071f1a8c to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:58:11,738 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@20e27139, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:58:11,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:11,738 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:11,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:11,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:11,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:11,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:11,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:11,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-02-08 00:58:11,739 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-02-08 00:58:11,739 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:58:11,741 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-02-08 00:58:11,743 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 310 msec 2023-02-08 00:58:11,787 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=238 (was 241), OpenFileDescriptor=607 (was 607), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=341 (was 367), ProcessCount=175 (was 175), AvailableMemoryMB=3688 (was 4138) 2023-02-08 00:58:11,798 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=238, OpenFileDescriptor=607, MaxFileDescriptor=60000, SystemLoadAverage=341, ProcessCount=175, AvailableMemoryMB=3682 2023-02-08 00:58:11,800 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:11,800 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:11,801 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-08 00:58:11,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-02-08 00:58:11,803 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 00:58:11,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-02-08 00:58:11,803 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:11,804 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:11,804 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 00:58:11,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-08 00:58:11,805 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1 2023-02-08 00:58:11,805 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1 empty. 2023-02-08 00:58:11,806 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1 2023-02-08 00:58:11,806 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-08 00:58:11,904 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:11,905 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:11,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-08 00:58:12,106 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:12,106 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:12,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-08 00:58:12,217 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-02-08 00:58:12,220 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => d1f084187b1c87f1355b3b50b6ba78e1, NAME => 'testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:58:12,407 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:12,407 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:12,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-08 00:58:12,629 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:12,630 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1603): Closing d1f084187b1c87f1355b3b50b6ba78e1, disabling compactions & flushes 2023-02-08 00:58:12,630 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. 2023-02-08 00:58:12,630 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. 2023-02-08 00:58:12,630 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. after waiting 0 ms 2023-02-08 00:58:12,630 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. 2023-02-08 00:58:12,630 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. 2023-02-08 00:58:12,630 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1557): Region close journal for d1f084187b1c87f1355b3b50b6ba78e1: Waiting for close lock at 1675817892630Disabling compacts and flushes for region at 1675817892630Disabling writes for close at 1675817892630Writing region close event to WAL at 1675817892630Closed at 1675817892630 2023-02-08 00:58:12,636 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 00:58:12,638 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675817892638"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817892638"}]},"ts":"1675817892638"} 2023-02-08 00:58:12,641 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 00:58:12,642 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 00:58:12,643 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817892642"}]},"ts":"1675817892642"} 2023-02-08 00:58:12,644 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-02-08 00:58:12,885 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d1f084187b1c87f1355b3b50b6ba78e1, ASSIGN}] 2023-02-08 00:58:12,887 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d1f084187b1c87f1355b3b50b6ba78e1, ASSIGN 2023-02-08 00:58:12,888 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=d1f084187b1c87f1355b3b50b6ba78e1, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:58:12,909 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:12,909 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:12,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-08 00:58:13,039 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d1f084187b1c87f1355b3b50b6ba78e1, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:13,039 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675817893039"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817893039"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817893039"}]},"ts":"1675817893039"} 2023-02-08 00:58:13,041 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure d1f084187b1c87f1355b3b50b6ba78e1, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:13,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. 2023-02-08 00:58:13,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => d1f084187b1c87f1355b3b50b6ba78e1, NAME => 'testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:58:13,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-02-08 00:58:13,201 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-02-08 00:58:13,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction d1f084187b1c87f1355b3b50b6ba78e1 2023-02-08 00:58:13,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:13,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for d1f084187b1c87f1355b3b50b6ba78e1 2023-02-08 00:58:13,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for d1f084187b1c87f1355b3b50b6ba78e1 2023-02-08 00:58:13,205 INFO [StoreOpener-d1f084187b1c87f1355b3b50b6ba78e1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region d1f084187b1c87f1355b3b50b6ba78e1 2023-02-08 00:58:13,207 DEBUG [StoreOpener-d1f084187b1c87f1355b3b50b6ba78e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1 2023-02-08 00:58:13,207 DEBUG [StoreOpener-d1f084187b1c87f1355b3b50b6ba78e1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1 2023-02-08 00:58:13,207 INFO [StoreOpener-d1f084187b1c87f1355b3b50b6ba78e1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d1f084187b1c87f1355b3b50b6ba78e1 columnFamilyName f1 2023-02-08 00:58:13,209 INFO [StoreOpener-d1f084187b1c87f1355b3b50b6ba78e1-1] regionserver.HStore(310): Store=d1f084187b1c87f1355b3b50b6ba78e1/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:13,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1 2023-02-08 00:58:13,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1 2023-02-08 00:58:13,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for d1f084187b1c87f1355b3b50b6ba78e1 2023-02-08 00:58:13,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:58:13,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened d1f084187b1c87f1355b3b50b6ba78e1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61128508, jitterRate=-0.089114248752594}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:58:13,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for d1f084187b1c87f1355b3b50b6ba78e1: Running coprocessor pre-open hook at 1675817893202Writing region info on filesystem at 1675817893202Initializing all the Stores at 1675817893204 (+2 ms)Instantiating store for column family {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817893204Cleaning up temporary data from old regions at 1675817893210 (+6 ms)Cleaning up detritus from prior splits at 1675817893210Running coprocessor post-open hooks at 1675817893214 (+4 ms)Region opened successfully at 1675817893214 2023-02-08 00:58:13,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1., pid=73, masterSystemTime=1675817893192 2023-02-08 00:58:13,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. 2023-02-08 00:58:13,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. 2023-02-08 00:58:13,216 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=d1f084187b1c87f1355b3b50b6ba78e1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:13,216 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675817893216"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817893216"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817893216"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817893216"}]},"ts":"1675817893216"} 2023-02-08 00:58:13,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=72 2023-02-08 00:58:13,218 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure d1f084187b1c87f1355b3b50b6ba78e1, server=jenkins-hbase12.apache.org,36907,1675817727419 in 176 msec 2023-02-08 00:58:13,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=72, resume processing ppid=71 2023-02-08 00:58:13,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=d1f084187b1c87f1355b3b50b6ba78e1, ASSIGN in 333 msec 2023-02-08 00:58:13,219 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 00:58:13,220 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817893220"}]},"ts":"1675817893220"} 2023-02-08 00:58:13,221 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-02-08 00:58:13,587 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 00:58:13,590 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.7870 sec 2023-02-08 00:58:13,910 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:13,910 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:13,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=71 2023-02-08 00:58:13,912 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-02-08 00:58:13,912 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-02-08 00:58:13,912 DEBUG [Listener at localhost.localdomain/36213] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-02-08 00:58:13,915 INFO [Listener at localhost.localdomain/36213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 00:58:13,919 INFO [Listener at localhost.localdomain/36213] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-02-08 00:58:13,920 INFO [Listener at localhost.localdomain/36213] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-02-08 00:58:13,920 INFO [Listener at localhost.localdomain/36213] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-02-08 00:58:13,925 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2744): Flushing d1f084187b1c87f1355b3b50b6ba78e1 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-08 00:58:14,340 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020889dbc7e00f894f019ba0d8a78d899258 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020889dbc7e00f894f019ba0d8a78d899258 2023-02-08 00:58:14,593 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:58:14,748 INFO [Listener at localhost.localdomain/36213] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/.tmp/f1/f58fe5fe4a4045729e15997788eb6134 2023-02-08 00:58:14,759 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/.tmp/f1/f58fe5fe4a4045729e15997788eb6134 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134 2023-02-08 00:58:14,766 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134, entries=1, sequenceid=5, filesize=4.9 K 2023-02-08 00:58:14,767 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for d1f084187b1c87f1355b3b50b6ba78e1 in 842ms, sequenceid=5, compaction requested=false 2023-02-08 00:58:14,768 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2445): Flush status journal for d1f084187b1c87f1355b3b50b6ba78e1: 2023-02-08 00:58:14,770 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2744): Flushing d1f084187b1c87f1355b3b50b6ba78e1 1/1 column families, dataSize=37 B heapSize=368 B 2023-02-08 00:58:15,185 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020889fc68a8e80e4516a523df174214ad24 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020889fc68a8e80e4516a523df174214ad24 2023-02-08 00:58:15,480 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-08 00:58:15,480 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-02-08 00:58:15,592 INFO [Listener at localhost.localdomain/36213] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/.tmp/f1/f0f5c2346f7b4214b5bc9636aff1658d 2023-02-08 00:58:15,602 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/.tmp/f1/f0f5c2346f7b4214b5bc9636aff1658d as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d 2023-02-08 00:58:15,607 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d, entries=1, sequenceid=9, filesize=4.9 K 2023-02-08 00:58:15,607 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2947): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for d1f084187b1c87f1355b3b50b6ba78e1 in 837ms, sequenceid=9, compaction requested=false 2023-02-08 00:58:15,608 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2445): Flush status journal for d1f084187b1c87f1355b3b50b6ba78e1: 2023-02-08 00:58:15,609 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-02-08 00:58:15,610 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-08 00:58:15,610 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-08 00:58:15,611 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818495611 2023-02-08 00:58:15,611 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:58:15,611 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-08 00:58:15,611 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-02-08 00:58:15,611 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-02-08 00:58:15,612 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x4867b20d to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:58:15,660 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:15,660 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:15,712 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:15,712 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:15,764 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:15,764 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:15,815 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:15,815 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:15,866 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:15,866 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:15,914 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bbf7981, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:58:15,915 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230208 for table='testGetAfterCompaction' and column='f1' 2023-02-08 00:58:15,917 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:15,917 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:15,968 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:15,968 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,019 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,019 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,071 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,071 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,122 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,122 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,173 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,173 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,224 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,225 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,276 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,276 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,327 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,327 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,378 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,378 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,429 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,430 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,481 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,481 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,532 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,532 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,582 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,583 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,633 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,634 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,684 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,685 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,736 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,736 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,751 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208aee6b7f3183b4bdbb453820e1d0c4ecf to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230208aee6b7f3183b4bdbb453820e1d0c4ecf 2023-02-08 00:58:16,753 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testGetAfterCompaction' column='f1' 2023-02-08 00:58:16,771 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:58:16,772 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:39078, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:58:16,777 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:16,777 INFO [MobCompactor-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:16,778 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:58:16,779 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:39886, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:58:16,786 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,786 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,788 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/f1/c46f3985355e4c729f0c21ae75c43047 first=Optional[r1] last=Optional[r2] 2023-02-08 00:58:16,789 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{f1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/f1/c46f3985355e4c729f0c21ae75c43047}] 2023-02-08 00:58:16,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/f1/c46f3985355e4c729f0c21ae75c43047 for inclusion in d1f084187b1c87f1355b3b50b6ba78e1/f1 2023-02-08 00:58:16,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-02-08 00:58:16,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:58:16,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for d1f084187b1c87f1355b3b50b6ba78e1: 2023-02-08 00:58:16,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/f1/c46f3985355e4c729f0c21ae75c43047 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testGetAfterCompaction__54gnmch96s8pdh3kb5hi0qe4s7oing304r6fncsup22bo01hqkuuvqe0h6akkjs8/f1/c46f3985355e4c729f0c21ae75c43047 2023-02-08 00:58:16,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testGetAfterCompaction__54gnmch96s8pdh3kb5hi0qe4s7oing304r6fncsup22bo01hqkuuvqe0h6akkjs8/f1/c46f3985355e4c729f0c21ae75c43047 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_ 2023-02-08 00:58:16,803 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testGetAfterCompaction__54gnmch96s8pdh3kb5hi0qe4s7oing304r6fncsup22bo01hqkuuvqe0h6akkjs8/f1/c46f3985355e4c729f0c21ae75c43047 into d1f084187b1c87f1355b3b50b6ba78e1/f1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_ - updating store file list. 2023-02-08 00:58:16,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_ into d1f084187b1c87f1355b3b50b6ba78e1/f1 2023-02-08 00:58:16,807 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testGetAfterCompaction__54gnmch96s8pdh3kb5hi0qe4s7oing304r6fncsup22bo01hqkuuvqe0h6akkjs8/f1/c46f3985355e4c729f0c21ae75c43047 into d1f084187b1c87f1355b3b50b6ba78e1/f1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_) 2023-02-08 00:58:16,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testGetAfterCompaction__54gnmch96s8pdh3kb5hi0qe4s7oing304r6fncsup22bo01hqkuuvqe0h6akkjs8/f1/c46f3985355e4c729f0c21ae75c43047 2023-02-08 00:58:16,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): d1f084187b1c87f1355b3b50b6ba78e1/f1 is initiating minor compaction 2023-02-08 00:58:16,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1958d312; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-08 00:58:16,808 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of d1f084187b1c87f1355b3b50b6ba78e1/f1 in testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. 2023-02-08 00:58:16,808 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/.tmp, totalSize=10.0 K 2023-02-08 00:58:16,808 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting f0f5c2346f7b4214b5bc9636aff1658d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 00:58:16,808 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 00:58:16,811 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testGetAfterCompaction' column='f1' 2023-02-08 00:58:16,812 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:16,814 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020889dbc7e00f894f019ba0d8a78d899258 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020889dbc7e00f894f019ba0d8a78d899258 2023-02-08 00:58:16,815 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020889fc68a8e80e4516a523df174214ad24 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e2023020889fc68a8e80e4516a523df174214ad24 2023-02-08 00:58:16,816 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-02-08 00:58:16,816 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20230208' 2023-02-08 00:58:16,816 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230208 for table='testGetAfterCompaction' and column='f1' 2023-02-08 00:58:16,816 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-02-08 00:58:16,816 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:58:16,817 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-02-08 00:58:16,819 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 1.2080 sec 2023-02-08 00:58:16,819 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): d1f084187b1c87f1355b3b50b6ba78e1#f1#compaction#77 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 57.69 MB/second 2023-02-08 00:58:16,837 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:16,837 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,837 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,841 DEBUG [Listener at localhost.localdomain/36213] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-02-08 00:58:16,845 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:39080, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-02-08 00:58:16,845 INFO [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36907] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. 2023-02-08 00:58:16,845 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-02-08 00:58:16,846 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-08 00:58:16,846 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36907] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-08 00:58:16,846 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36907] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. because compaction request was cancelled 2023-02-08 00:58:16,898 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:16,898 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,899 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,950 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:16,951 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:16,951 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,003 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,003 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,003 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,054 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,055 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,055 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,106 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,106 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,106 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,158 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,158 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,158 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,210 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,210 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,211 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,262 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,262 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,262 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,313 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,313 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,313 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,364 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,365 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,365 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,416 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,416 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,416 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,468 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,468 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,468 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,519 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,520 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,520 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,571 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,571 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,571 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,622 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,622 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,623 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,641 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/.tmp/f1/b7d0690b0712416f895ac3624aaebdb5 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/b7d0690b0712416f895ac3624aaebdb5 2023-02-08 00:58:17,646 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in d1f084187b1c87f1355b3b50b6ba78e1/f1 of d1f084187b1c87f1355b3b50b6ba78e1 into b7d0690b0712416f895ac3624aaebdb5(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:58:17,646 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for d1f084187b1c87f1355b3b50b6ba78e1: 2023-02-08 00:58:17,646 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1675817896808; duration=0sec 2023-02-08 00:58:17,646 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:58:17,674 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,674 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/b7d0690b0712416f895ac3624aaebdb5; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675817897630; access_time=1675817896815; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,674 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,674 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,726 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_] to archive 2023-02-08 00:58:17,728 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1675817896744; access_time=1675817895929; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-02-08 00:58:17,728 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/b7d0690b0712416f895ac3624aaebdb5; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675817897630; access_time=1675817896815; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,728 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817895591; access_time=1675817894772; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,728 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,728 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:17,730 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f0f5c2346f7b4214b5bc9636aff1658d 2023-02-08 00:58:17,732 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/7dfbf3bf82624db2a4abc7e0d5ce079e_SeqId_12_ 2023-02-08 00:58:17,780 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/b7d0690b0712416f895ac3624aaebdb5; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1675817897630; access_time=1675817896815; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,780 INFO [Listener at localhost.localdomain/36213] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1675817894747; access_time=1675817893928; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-02-08 00:58:17,907 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:17,907 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:17,908 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-02-08 00:58:17,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$11(2405): Client=jenkins//136.243.104.168 disable testGetAfterCompaction 2023-02-08 00:58:17,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-02-08 00:58:17,921 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817897921"}]},"ts":"1675817897921"} 2023-02-08 00:58:17,922 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:17,922 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:17,922 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-02-08 00:58:17,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-08 00:58:17,957 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-02-08 00:58:17,959 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d1f084187b1c87f1355b3b50b6ba78e1, UNASSIGN}] 2023-02-08 00:58:17,960 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=d1f084187b1c87f1355b3b50b6ba78e1, UNASSIGN 2023-02-08 00:58:17,961 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d1f084187b1c87f1355b3b50b6ba78e1, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:17,961 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675817897961"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817897961"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817897961"}]},"ts":"1675817897961"} 2023-02-08 00:58:17,963 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure d1f084187b1c87f1355b3b50b6ba78e1, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:18,023 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:18,023 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:18,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-08 00:58:18,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close d1f084187b1c87f1355b3b50b6ba78e1 2023-02-08 00:58:18,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing d1f084187b1c87f1355b3b50b6ba78e1, disabling compactions & flushes 2023-02-08 00:58:18,115 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. 2023-02-08 00:58:18,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. 2023-02-08 00:58:18,115 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. after waiting 0 ms 2023-02-08 00:58:18,116 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. 2023-02-08 00:58:18,120 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-08 00:58:18,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-08 00:58:18,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1. 2023-02-08 00:58:18,123 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for d1f084187b1c87f1355b3b50b6ba78e1: Waiting for close lock at 1675817898115Running coprocessor pre-close hooks at 1675817898115Disabling compacts and flushes for region at 1675817898115Disabling writes for close at 1675817898116 (+1 ms)Writing region close event to WAL at 1675817898116Running coprocessor post-close hooks at 1675817898121 (+5 ms)Closed at 1675817898123 (+2 ms) 2023-02-08 00:58:18,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed d1f084187b1c87f1355b3b50b6ba78e1 2023-02-08 00:58:18,126 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=d1f084187b1c87f1355b3b50b6ba78e1, regionState=CLOSED 2023-02-08 00:58:18,126 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1675817898126"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817898126"}]},"ts":"1675817898126"} 2023-02-08 00:58:18,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-02-08 00:58:18,131 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure d1f084187b1c87f1355b3b50b6ba78e1, server=jenkins-hbase12.apache.org,36907,1675817727419 in 165 msec 2023-02-08 00:58:18,132 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=75 2023-02-08 00:58:18,133 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=d1f084187b1c87f1355b3b50b6ba78e1, UNASSIGN in 172 msec 2023-02-08 00:58:18,133 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817898133"}]},"ts":"1675817898133"} 2023-02-08 00:58:18,134 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-02-08 00:58:18,225 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:18,225 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:18,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-08 00:58:18,443 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-02-08 00:58:18,449 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 532 msec 2023-02-08 00:58:18,527 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:18,527 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:18,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=75 2023-02-08 00:58:18,528 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-02-08 00:58:18,529 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:18,529 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:18,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$5(2215): Client=jenkins//136.243.104.168 delete testGetAfterCompaction 2023-02-08 00:58:18,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-02-08 00:58:18,544 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-08 00:58:18,546 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-08 00:58:18,546 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:18,546 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:18,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-08 00:58:18,548 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1 2023-02-08 00:58:18,550 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1, FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/recovered.edits] 2023-02-08 00:58:18,553 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/b7d0690b0712416f895ac3624aaebdb5 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/b7d0690b0712416f895ac3624aaebdb5 2023-02-08 00:58:18,554 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/f1/f58fe5fe4a4045729e15997788eb6134 2023-02-08 00:58:18,557 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/recovered.edits/15.seqid to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1/recovered.edits/15.seqid 2023-02-08 00:58:18,557 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testGetAfterCompaction/d1f084187b1c87f1355b3b50b6ba78e1 2023-02-08 00:58:18,557 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-02-08 00:58:18,558 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-08 00:58:18,558 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-02-08 00:58:18,563 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230208aee6b7f3183b4bdbb453820e1d0c4ecf to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20230208aee6b7f3183b4bdbb453820e1d0c4ecf 2023-02-08 00:58:18,563 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-02-08 00:58:18,565 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-08 00:58:18,592 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-02-08 00:58:18,594 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-02-08 00:58:18,595 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-08 00:58:18,595 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-02-08 00:58:18,595 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675817898595"}]},"ts":"9223372036854775807"} 2023-02-08 00:58:18,596 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-02-08 00:58:18,596 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d1f084187b1c87f1355b3b50b6ba78e1, NAME => 'testGetAfterCompaction,,1675817891801.d1f084187b1c87f1355b3b50b6ba78e1.', STARTKEY => '', ENDKEY => ''}] 2023-02-08 00:58:18,596 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-02-08 00:58:18,596 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1675817898596"}]},"ts":"9223372036854775807"} 2023-02-08 00:58:18,597 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-02-08 00:58:18,647 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:18,647 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:18,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-08 00:58:18,737 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-02-08 00:58:18,739 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 200 msec 2023-02-08 00:58:18,849 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:18,849 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:18,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=78 2023-02-08 00:58:18,852 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-02-08 00:58:18,871 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=239 (was 238) - Thread LEAK? -, OpenFileDescriptor=599 (was 607), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=330 (was 341), ProcessCount=177 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=3668 (was 3682) 2023-02-08 00:58:18,883 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=239, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=330, ProcessCount=177, AvailableMemoryMB=3667 2023-02-08 00:58:18,884 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:18,884 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:18,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-08 00:58:18,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-02-08 00:58:18,887 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 00:58:18,888 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-02-08 00:58:18,888 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:18,888 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 00:58:18,888 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:18,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-08 00:58:18,890 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:18,890 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:18,890 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:18,891 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee empty. 2023-02-08 00:58:18,891 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99 empty. 2023-02-08 00:58:18,891 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a empty. 2023-02-08 00:58:18,891 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:18,891 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:18,892 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:18,892 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-02-08 00:58:18,989 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:18,989 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:18,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-08 00:58:19,191 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:19,191 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:19,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-08 00:58:19,304 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-08 00:58:19,307 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7671): creating {ENCODED => 89a0ab87c56c5be47f5c7e5dcda828ee, NAME => 'testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:58:19,307 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7671): creating {ENCODED => 84c1293d4c4595b4d6d33cad2b445d99, NAME => 'testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:58:19,307 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7671): creating {ENCODED => 9338368da41aeb4a27fe667e7462918a, NAME => 'testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:58:19,313 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:19,313 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1603): Closing 9338368da41aeb4a27fe667e7462918a, disabling compactions & flushes 2023-02-08 00:58:19,313 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:19,313 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:19,313 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. after waiting 0 ms 2023-02-08 00:58:19,313 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:19,313 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:19,313 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1557): Region close journal for 9338368da41aeb4a27fe667e7462918a: Waiting for close lock at 1675817899313Disabling compacts and flushes for region at 1675817899313Disabling writes for close at 1675817899313Writing region close event to WAL at 1675817899313Closed at 1675817899313 2023-02-08 00:58:19,316 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:19,316 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1603): Closing 89a0ab87c56c5be47f5c7e5dcda828ee, disabling compactions & flushes 2023-02-08 00:58:19,316 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:19,316 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:19,316 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. after waiting 0 ms 2023-02-08 00:58:19,316 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:19,316 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:19,316 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1557): Region close journal for 89a0ab87c56c5be47f5c7e5dcda828ee: Waiting for close lock at 1675817899316Disabling compacts and flushes for region at 1675817899316Disabling writes for close at 1675817899316Writing region close event to WAL at 1675817899316Closed at 1675817899316 2023-02-08 00:58:19,492 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:19,493 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:19,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-08 00:58:19,714 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:19,714 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1603): Closing 84c1293d4c4595b4d6d33cad2b445d99, disabling compactions & flushes 2023-02-08 00:58:19,714 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:19,714 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:19,714 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. after waiting 0 ms 2023-02-08 00:58:19,714 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:19,714 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:19,715 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1557): Region close journal for 84c1293d4c4595b4d6d33cad2b445d99: Waiting for close lock at 1675817899714Disabling compacts and flushes for region at 1675817899714Disabling writes for close at 1675817899714Writing region close event to WAL at 1675817899714Closed at 1675817899714 2023-02-08 00:58:19,720 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 00:58:19,722 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675817899721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817899721"}]},"ts":"1675817899721"} 2023-02-08 00:58:19,722 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817899721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817899721"}]},"ts":"1675817899721"} 2023-02-08 00:58:19,722 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817899721"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817899721"}]},"ts":"1675817899721"} 2023-02-08 00:58:19,725 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-08 00:58:19,725 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 00:58:19,726 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817899725"}]},"ts":"1675817899725"} 2023-02-08 00:58:19,727 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-08 00:58:19,994 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:19,994 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:19,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-08 00:58:20,053 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89a0ab87c56c5be47f5c7e5dcda828ee, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9338368da41aeb4a27fe667e7462918a, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=84c1293d4c4595b4d6d33cad2b445d99, ASSIGN}] 2023-02-08 00:58:20,055 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=84c1293d4c4595b4d6d33cad2b445d99, ASSIGN 2023-02-08 00:58:20,055 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9338368da41aeb4a27fe667e7462918a, ASSIGN 2023-02-08 00:58:20,055 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89a0ab87c56c5be47f5c7e5dcda828ee, ASSIGN 2023-02-08 00:58:20,055 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=84c1293d4c4595b4d6d33cad2b445d99, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:58:20,056 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9338368da41aeb4a27fe667e7462918a, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:58:20,056 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89a0ab87c56c5be47f5c7e5dcda828ee, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:58:20,209 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=84c1293d4c4595b4d6d33cad2b445d99, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:20,209 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9338368da41aeb4a27fe667e7462918a, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:20,209 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=89a0ab87c56c5be47f5c7e5dcda828ee, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:20,209 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675817900209"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817900209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817900209"}]},"ts":"1675817900209"} 2023-02-08 00:58:20,209 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817900209"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817900209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817900209"}]},"ts":"1675817900209"} 2023-02-08 00:58:20,210 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817900209"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817900209"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817900209"}]},"ts":"1675817900209"} 2023-02-08 00:58:20,212 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure 9338368da41aeb4a27fe667e7462918a, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:20,213 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure 84c1293d4c4595b4d6d33cad2b445d99, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:20,216 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure 89a0ab87c56c5be47f5c7e5dcda828ee, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:20,355 INFO [AsyncFSWAL-0-hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData-prefix:jenkins-hbase12.apache.org,36763,1675817725340] wal.AbstractFSWAL(1045): Slow sync cost: 141 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:45165,DS-435253a9-76ab-4295-a971-e474cccc5f92,DISK]] 2023-02-08 00:58:20,355 INFO [AsyncFSWAL-0-hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData-prefix:jenkins-hbase12.apache.org,36763,1675817725340] wal.AbstractFSWAL(1045): Slow sync cost: 141 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:45165,DS-435253a9-76ab-4295-a971-e474cccc5f92,DISK]] 2023-02-08 00:58:20,355 INFO [AsyncFSWAL-0-hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData-prefix:jenkins-hbase12.apache.org,36763,1675817725340] wal.AbstractFSWAL(1045): Slow sync cost: 138 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:45165,DS-435253a9-76ab-4295-a971-e474cccc5f92,DISK]] 2023-02-08 00:58:20,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:20,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 84c1293d4c4595b4d6d33cad2b445d99, NAME => 'testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.', STARTKEY => '2', ENDKEY => ''} 2023-02-08 00:58:20,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:20,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:20,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:20,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:20,512 INFO [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:20,513 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1 2023-02-08 00:58:20,513 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1 2023-02-08 00:58:20,513 INFO [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84c1293d4c4595b4d6d33cad2b445d99 columnFamilyName family1 2023-02-08 00:58:20,514 INFO [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(310): Store=84c1293d4c4595b4d6d33cad2b445d99/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:20,515 INFO [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:20,515 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2 2023-02-08 00:58:20,515 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2 2023-02-08 00:58:20,516 INFO [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84c1293d4c4595b4d6d33cad2b445d99 columnFamilyName family2 2023-02-08 00:58:20,516 INFO [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(310): Store=84c1293d4c4595b4d6d33cad2b445d99/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:20,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:20,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:20,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:58:20,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:20,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:58:20,522 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 84c1293d4c4595b4d6d33cad2b445d99; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62552403, jitterRate=-0.06789655983448029}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:58:20,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 84c1293d4c4595b4d6d33cad2b445d99: Running coprocessor pre-open hook at 1675817900511Writing region info on filesystem at 1675817900511Initializing all the Stores at 1675817900512 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817900512Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817900512Cleaning up temporary data from old regions at 1675817900518 (+6 ms)Cleaning up detritus from prior splits at 1675817900518Running coprocessor post-open hooks at 1675817900522 (+4 ms)Region opened successfully at 1675817900522 2023-02-08 00:58:20,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99., pid=84, masterSystemTime=1675817900507 2023-02-08 00:58:20,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:20,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:20,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:20,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 89a0ab87c56c5be47f5c7e5dcda828ee, NAME => 'testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.', STARTKEY => '', ENDKEY => '1'} 2023-02-08 00:58:20,525 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=84c1293d4c4595b4d6d33cad2b445d99, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:20,525 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817900525"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817900525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817900525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817900525"}]},"ts":"1675817900525"} 2023-02-08 00:58:20,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:20,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:20,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:20,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:20,527 INFO [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:20,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=84, resume processing ppid=82 2023-02-08 00:58:20,528 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1 2023-02-08 00:58:20,528 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1 2023-02-08 00:58:20,528 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure 84c1293d4c4595b4d6d33cad2b445d99, server=jenkins-hbase12.apache.org,36907,1675817727419 in 314 msec 2023-02-08 00:58:20,529 INFO [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89a0ab87c56c5be47f5c7e5dcda828ee columnFamilyName family1 2023-02-08 00:58:20,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=84c1293d4c4595b4d6d33cad2b445d99, ASSIGN in 475 msec 2023-02-08 00:58:20,530 INFO [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(310): Store=89a0ab87c56c5be47f5c7e5dcda828ee/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:20,530 INFO [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:20,532 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2 2023-02-08 00:58:20,532 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2 2023-02-08 00:58:20,532 INFO [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89a0ab87c56c5be47f5c7e5dcda828ee columnFamilyName family2 2023-02-08 00:58:20,533 INFO [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(310): Store=89a0ab87c56c5be47f5c7e5dcda828ee/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:20,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:20,534 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:20,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:58:20,537 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:20,538 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:58:20,539 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 89a0ab87c56c5be47f5c7e5dcda828ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61439228, jitterRate=-0.08448415994644165}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:58:20,539 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 89a0ab87c56c5be47f5c7e5dcda828ee: Running coprocessor pre-open hook at 1675817900526Writing region info on filesystem at 1675817900526Initializing all the Stores at 1675817900526Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817900526Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817900527 (+1 ms)Cleaning up temporary data from old regions at 1675817900535 (+8 ms)Cleaning up detritus from prior splits at 1675817900535Running coprocessor post-open hooks at 1675817900539 (+4 ms)Region opened successfully at 1675817900539 2023-02-08 00:58:20,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee., pid=85, masterSystemTime=1675817900507 2023-02-08 00:58:20,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:20,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:20,541 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:20,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9338368da41aeb4a27fe667e7462918a, NAME => 'testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.', STARTKEY => '1', ENDKEY => '2'} 2023-02-08 00:58:20,541 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=89a0ab87c56c5be47f5c7e5dcda828ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:20,542 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817900541"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817900541"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817900541"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817900541"}]},"ts":"1675817900541"} 2023-02-08 00:58:20,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:20,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:20,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:20,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:20,543 INFO [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:20,544 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=80 2023-02-08 00:58:20,544 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure 89a0ab87c56c5be47f5c7e5dcda828ee, server=jenkins-hbase12.apache.org,36907,1675817727419 in 329 msec 2023-02-08 00:58:20,545 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1 2023-02-08 00:58:20,545 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1 2023-02-08 00:58:20,545 INFO [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9338368da41aeb4a27fe667e7462918a columnFamilyName family1 2023-02-08 00:58:20,545 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89a0ab87c56c5be47f5c7e5dcda828ee, ASSIGN in 492 msec 2023-02-08 00:58:20,550 INFO [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(310): Store=9338368da41aeb4a27fe667e7462918a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:20,551 INFO [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:20,552 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2 2023-02-08 00:58:20,552 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2 2023-02-08 00:58:20,552 INFO [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9338368da41aeb4a27fe667e7462918a columnFamilyName family2 2023-02-08 00:58:20,553 INFO [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(310): Store=9338368da41aeb4a27fe667e7462918a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:20,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:20,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:20,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:58:20,556 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:20,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:58:20,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 9338368da41aeb4a27fe667e7462918a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60772673, jitterRate=-0.09441660344600677}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:58:20,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 9338368da41aeb4a27fe667e7462918a: Running coprocessor pre-open hook at 1675817900542Writing region info on filesystem at 1675817900542Initializing all the Stores at 1675817900543 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817900543Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817900543Cleaning up temporary data from old regions at 1675817900555 (+12 ms)Cleaning up detritus from prior splits at 1675817900555Running coprocessor post-open hooks at 1675817900558 (+3 ms)Region opened successfully at 1675817900558 2023-02-08 00:58:20,558 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a., pid=83, masterSystemTime=1675817900507 2023-02-08 00:58:20,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:20,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:20,560 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=9338368da41aeb4a27fe667e7462918a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:20,560 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675817900560"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817900560"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817900560"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817900560"}]},"ts":"1675817900560"} 2023-02-08 00:58:20,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=83, resume processing ppid=81 2023-02-08 00:58:20,562 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure 9338368da41aeb4a27fe667e7462918a, server=jenkins-hbase12.apache.org,36907,1675817727419 in 349 msec 2023-02-08 00:58:20,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=79 2023-02-08 00:58:20,563 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9338368da41aeb4a27fe667e7462918a, ASSIGN in 510 msec 2023-02-08 00:58:20,563 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 00:58:20,563 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817900563"}]},"ts":"1675817900563"} 2023-02-08 00:58:20,564 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-08 00:58:20,915 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 00:58:20,917 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 2.0310 sec 2023-02-08 00:58:20,997 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:20,997 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:20,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=79 2023-02-08 00:58:20,998 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-02-08 00:58:21,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:21,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:21,009 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:21,012 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:21,013 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:21,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:58:21,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-08 00:58:21,015 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-08 00:58:21,015 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:21,015 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-08 00:58:21,015 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-08 00:58:21,016 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:21,016 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:21,316 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:21,316 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:21,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:21,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:21,317 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:21,317 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:58:21,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:21,318 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:58:21,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:21,319 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-08 00:58:21,319 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-08 00:58:21,319 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-08 00:58:21,320 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:21,320 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-08 00:58:21,320 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:21,320 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. started... 2023-02-08 00:58:21,320 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:21,320 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:58:21,321 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:21,321 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:58:21,321 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9338368da41aeb4a27fe667e7462918a 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 00:58:21,320 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. started... 2023-02-08 00:58:21,322 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. started... 2023-02-08 00:58:21,323 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 84c1293d4c4595b4d6d33cad2b445d99 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 00:58:21,324 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 89a0ab87c56c5be47f5c7e5dcda828ee 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 00:58:21,737 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208ab9f748451af4fc2955f7c9bad85c063 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208ab9f748451af4fc2955f7c9bad85c063 2023-02-08 00:58:21,737 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020813f48f83788542e6a6b76968ab2feb40 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020813f48f83788542e6a6b76968ab2feb40 2023-02-08 00:58:21,737 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302081b8a3787433e4edb8acf766920c2cd58 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302081b8a3787433e4edb8acf766920c2cd58 2023-02-08 00:58:21,742 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family1/0b47b0d0ff374ba5a83918d6ec87722c 2023-02-08 00:58:22,142 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family1/61f44948dce74812a54741846e65864f 2023-02-08 00:58:22,147 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family1/32ad3bac17fc4da182401fd0674b4161 2023-02-08 00:58:22,166 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208bef91af772c44e37919c302ef0a67f9b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208bef91af772c44e37919c302ef0a67f9b 2023-02-08 00:58:22,167 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020833a33c13ac654a35ac6d3ca7e9a9edf1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020833a33c13ac654a35ac6d3ca7e9a9edf1 2023-02-08 00:58:22,570 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302081e6a0735946344caacd20b5274d0f3af to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302081e6a0735946344caacd20b5274d0f3af 2023-02-08 00:58:22,571 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family2/7248a2815e884b62be416154b778eb7b 2023-02-08 00:58:22,571 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family2/fb369dd9a58b499abdc4074a96c392a8 2023-02-08 00:58:22,578 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family1/0b47b0d0ff374ba5a83918d6ec87722c as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/0b47b0d0ff374ba5a83918d6ec87722c 2023-02-08 00:58:22,578 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family1/32ad3bac17fc4da182401fd0674b4161 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/32ad3bac17fc4da182401fd0674b4161 2023-02-08 00:58:22,582 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/32ad3bac17fc4da182401fd0674b4161, entries=4, sequenceid=5, filesize=5.4 K 2023-02-08 00:58:22,582 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/0b47b0d0ff374ba5a83918d6ec87722c, entries=4, sequenceid=5, filesize=5.4 K 2023-02-08 00:58:22,583 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family2/fb369dd9a58b499abdc4074a96c392a8 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/fb369dd9a58b499abdc4074a96c392a8 2023-02-08 00:58:22,583 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family2/7248a2815e884b62be416154b778eb7b as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/7248a2815e884b62be416154b778eb7b 2023-02-08 00:58:22,586 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/fb369dd9a58b499abdc4074a96c392a8, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 00:58:22,587 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/7248a2815e884b62be416154b778eb7b, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 00:58:22,587 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 9338368da41aeb4a27fe667e7462918a in 1266ms, sequenceid=5, compaction requested=false 2023-02-08 00:58:22,587 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-08 00:58:22,587 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 89a0ab87c56c5be47f5c7e5dcda828ee in 1264ms, sequenceid=5, compaction requested=false 2023-02-08 00:58:22,587 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-08 00:58:22,588 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9338368da41aeb4a27fe667e7462918a: 2023-02-08 00:58:22,588 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 89a0ab87c56c5be47f5c7e5dcda828ee: 2023-02-08 00:58:22,588 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:22,588 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:22,588 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:58:22,588 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:58:22,981 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family2/30ce6d15bc614f898acca9ea78c25ab0 2023-02-08 00:58:22,990 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family1/61f44948dce74812a54741846e65864f as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/61f44948dce74812a54741846e65864f 2023-02-08 00:58:22,996 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/61f44948dce74812a54741846e65864f, entries=4, sequenceid=5, filesize=5.4 K 2023-02-08 00:58:22,997 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family2/30ce6d15bc614f898acca9ea78c25ab0 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/30ce6d15bc614f898acca9ea78c25ab0 2023-02-08 00:58:23,003 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/30ce6d15bc614f898acca9ea78c25ab0, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 00:58:23,004 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 84c1293d4c4595b4d6d33cad2b445d99 in 1681ms, sequenceid=5, compaction requested=false 2023-02-08 00:58:23,004 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 84c1293d4c4595b4d6d33cad2b445d99: 2023-02-08 00:58:23,004 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:23,004 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:58:23,004 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:58:23,004 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:23,005 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-08 00:58:23,005 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-08 00:58:23,273 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:23,273 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:23,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:23,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:23,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:23,274 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:23,274 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:58:23,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:23,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:23,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:23,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:23,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:23,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-08 00:58:23,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@353ab9a[Count = 0] remaining members to acquire global barrier 2023-02-08 00:58:23,279 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-08 00:58:23,279 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:23,334 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:23,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:23,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:23,335 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-08 00:58:23,335 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-08 00:58:23,335 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:58:23,335 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:23,335 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:58:23,367 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:23,367 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-08 00:58:23,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:23,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:23,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:23,367 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:23,368 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-08 00:58:23,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:23,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:23,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:23,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:23,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:23,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:23,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:23,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:58:23,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-08 00:58:23,370 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-08 00:58:23,370 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:58:23,370 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:58:23,370 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-08 00:58:23,370 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:58:23,379 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:23,379 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:23,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:23,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:23,380 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:23,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:23,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:23,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:23,380 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:23,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:23,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:23,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:23,380 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:23,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:23,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:23,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:23,382 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:23,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:23,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:23,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:23,624 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:58:23,695 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:23,695 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:23,695 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:23,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-08 00:58:23,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:58:23,695 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:23,695 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:23,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:23,695 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:23,696 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-08 00:58:23,695 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:23,696 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:23,695 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-08 00:58:23,696 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:23,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:23,696 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:23,696 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:58:23,696 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:23,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:23,796 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:58:23,796 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:23,797 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:23,797 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:58:23,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:23,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:23,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:23,804 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:23,804 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:23,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:58:23,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-08 00:58:23,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-08 00:58:23,809 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-08 00:58:23,809 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:23,809 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-08 00:58:23,809 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-08 00:58:23,809 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:23,810 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:24,084 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:24,084 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:24,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:24,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:24,085 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:24,085 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:58:24,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:24,085 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:24,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:58:24,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:24,086 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-08 00:58:24,088 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-08 00:58:24,088 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-08 00:58:24,088 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-08 00:58:24,088 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:24,088 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-08 00:58:24,089 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:24,089 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. started... 2023-02-08 00:58:24,089 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9338368da41aeb4a27fe667e7462918a 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 00:58:24,093 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:58:24,096 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:58:24,096 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:24,096 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. started... 2023-02-08 00:58:24,096 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 84c1293d4c4595b4d6d33cad2b445d99 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 00:58:24,096 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:24,097 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. started... 2023-02-08 00:58:24,099 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 89a0ab87c56c5be47f5c7e5dcda828ee 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 00:58:24,158 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208bee32da1c78040568b8d603fc9195d12 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208bee32da1c78040568b8d603fc9195d12 2023-02-08 00:58:24,165 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family1/914020f3714948679271bb1ac4014cbe 2023-02-08 00:58:24,185 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020821528418aaf9477e92907e8ec449a337 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020821528418aaf9477e92907e8ec449a337 2023-02-08 00:58:24,190 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family2/96f0852960e949968254a73c25713b7f 2023-02-08 00:58:24,194 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family1/914020f3714948679271bb1ac4014cbe as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/914020f3714948679271bb1ac4014cbe 2023-02-08 00:58:24,199 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/914020f3714948679271bb1ac4014cbe, entries=4, sequenceid=9, filesize=5.4 K 2023-02-08 00:58:24,201 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family2/96f0852960e949968254a73c25713b7f as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/96f0852960e949968254a73c25713b7f 2023-02-08 00:58:24,207 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/96f0852960e949968254a73c25713b7f, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 00:58:24,208 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 9338368da41aeb4a27fe667e7462918a in 119ms, sequenceid=9, compaction requested=false 2023-02-08 00:58:24,208 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9338368da41aeb4a27fe667e7462918a: 2023-02-08 00:58:24,208 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:24,209 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:58:24,554 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302083115e47f274a4d269d511449ed28dd95 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302083115e47f274a4d269d511449ed28dd95 2023-02-08 00:58:24,559 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208cfe0bba23e494aad8459db2f96458784 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208cfe0bba23e494aad8459db2f96458784 2023-02-08 00:58:24,559 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family1/157d1d946a37498ba85c679a775a8e5f 2023-02-08 00:58:24,964 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family1/2711b734a9a54aeb873ac5781a17315b 2023-02-08 00:58:24,972 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302083ea0c834f4ae49b4bb92308e8e5677b9 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302083ea0c834f4ae49b4bb92308e8e5677b9 2023-02-08 00:58:24,976 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family2/79201498d5624db5882d048fb42c97bf 2023-02-08 00:58:24,980 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family1/157d1d946a37498ba85c679a775a8e5f as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/157d1d946a37498ba85c679a775a8e5f 2023-02-08 00:58:24,982 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/157d1d946a37498ba85c679a775a8e5f, entries=4, sequenceid=9, filesize=5.4 K 2023-02-08 00:58:24,983 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family2/79201498d5624db5882d048fb42c97bf as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/79201498d5624db5882d048fb42c97bf 2023-02-08 00:58:24,986 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/79201498d5624db5882d048fb42c97bf, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 00:58:24,987 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 89a0ab87c56c5be47f5c7e5dcda828ee in 888ms, sequenceid=9, compaction requested=false 2023-02-08 00:58:24,987 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 89a0ab87c56c5be47f5c7e5dcda828ee: 2023-02-08 00:58:24,987 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:24,987 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:58:25,480 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-02-08 00:58:25,535 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208a5a2b190b2c84b328d97038f63fcf2cc to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208a5a2b190b2c84b328d97038f63fcf2cc 2023-02-08 00:58:25,945 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family2/f6708c31fcad404f87bd2d268f67f8a6 2023-02-08 00:58:25,955 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family1/2711b734a9a54aeb873ac5781a17315b as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/2711b734a9a54aeb873ac5781a17315b 2023-02-08 00:58:25,959 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/2711b734a9a54aeb873ac5781a17315b, entries=4, sequenceid=9, filesize=5.4 K 2023-02-08 00:58:25,960 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family2/f6708c31fcad404f87bd2d268f67f8a6 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/f6708c31fcad404f87bd2d268f67f8a6 2023-02-08 00:58:25,965 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/f6708c31fcad404f87bd2d268f67f8a6, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 00:58:25,966 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 84c1293d4c4595b4d6d33cad2b445d99 in 1870ms, sequenceid=9, compaction requested=false 2023-02-08 00:58:25,966 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 84c1293d4c4595b4d6d33cad2b445d99: 2023-02-08 00:58:25,966 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:25,966 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:58:25,966 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:58:25,966 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:25,966 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-08 00:58:25,966 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-08 00:58:26,221 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:26,221 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:26,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:26,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:26,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:26,223 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:26,223 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:58:26,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:26,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:26,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:26,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:26,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:26,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-08 00:58:26,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@cf73be2[Count = 0] remaining members to acquire global barrier 2023-02-08 00:58:26,228 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-08 00:58:26,228 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:26,305 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:26,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:26,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:26,306 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-08 00:58:26,306 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:26,306 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:58:26,306 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-08 00:58:26,306 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:58:26,317 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-08 00:58:26,317 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:26,317 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:26,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:26,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:26,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:26,317 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-08 00:58:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:26,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:26,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:26,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:26,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:26,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:26,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:26,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:58:26,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-08 00:58:26,320 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-08 00:58:26,321 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:58:26,321 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:58:26,321 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-08 00:58:26,321 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:58:26,337 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:26,337 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:26,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:26,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:26,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:26,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:26,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:26,337 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:26,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:26,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:26,338 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:26,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:26,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:26,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:26,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:26,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:26,339 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:26,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:26,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:26,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:26,642 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:26,643 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:26,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:26,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-08 00:58:26,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:58:26,642 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:26,644 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:26,643 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:26,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:26,644 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-08 00:58:26,645 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:58:26,644 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:26,644 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-08 00:58:26,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:26,645 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:26,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:26,646 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:26,646 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:26,646 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:26,745 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:58:26,745 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:26,746 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:26,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:58:26,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:26,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:26,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:26,756 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:26,756 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:26,757 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:58:26,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-08 00:58:26,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-08 00:58:26,759 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-08 00:58:26,759 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:26,759 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-08 00:58:26,759 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-08 00:58:26,759 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:26,759 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:27,021 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:27,021 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:27,021 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:27,022 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:27,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:27,022 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:58:27,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:58:27,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:27,024 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-08 00:58:27,025 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-08 00:58:27,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-08 00:58:27,025 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-08 00:58:27,025 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:27,025 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-08 00:58:27,026 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:27,026 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. started... 2023-02-08 00:58:27,026 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:27,026 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:58:27,027 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:58:27,026 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:27,027 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. started... 2023-02-08 00:58:27,026 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9338368da41aeb4a27fe667e7462918a 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 00:58:27,026 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. started... 2023-02-08 00:58:27,027 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 89a0ab87c56c5be47f5c7e5dcda828ee 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 00:58:27,027 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 84c1293d4c4595b4d6d33cad2b445d99 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 00:58:27,448 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302086b17a8d7ccd645b2b72c8b5050e3ac1c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302086b17a8d7ccd645b2b72c8b5050e3ac1c 2023-02-08 00:58:27,448 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208634b7040b5f847b5bc9c60cf18a2a8c3 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208634b7040b5f847b5bc9c60cf18a2a8c3 2023-02-08 00:58:27,448 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208fc9f29a8895f4095863045e0578d9bbc to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208fc9f29a8895f4095863045e0578d9bbc 2023-02-08 00:58:27,454 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family1/a3ba9365b9d84749af18cbd50c81216b 2023-02-08 00:58:27,854 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family1/f28538b2d96b458c9e94d1487098428b 2023-02-08 00:58:27,854 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family1/181d16d9fb42455aa19a563ddb119b7a 2023-02-08 00:58:27,867 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302086f4ce6fa80f94dd1b3fe89261efb03cd to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302086f4ce6fa80f94dd1b3fe89261efb03cd 2023-02-08 00:58:28,273 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family2/2e583228507e4466b431aef4d66e0550 2023-02-08 00:58:28,277 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208c39437fd949e4f099ddea261ae0acbd0 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208c39437fd949e4f099ddea261ae0acbd0 2023-02-08 00:58:28,277 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208517de1d54dd442e8bc8bd34da4d0c697 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208517de1d54dd442e8bc8bd34da4d0c697 2023-02-08 00:58:28,281 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family1/a3ba9365b9d84749af18cbd50c81216b as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a3ba9365b9d84749af18cbd50c81216b 2023-02-08 00:58:28,285 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a3ba9365b9d84749af18cbd50c81216b, entries=4, sequenceid=13, filesize=5.4 K 2023-02-08 00:58:28,285 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family2/2e583228507e4466b431aef4d66e0550 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/2e583228507e4466b431aef4d66e0550 2023-02-08 00:58:28,289 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/2e583228507e4466b431aef4d66e0550, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 00:58:28,290 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 9338368da41aeb4a27fe667e7462918a in 1264ms, sequenceid=13, compaction requested=true 2023-02-08 00:58:28,290 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9338368da41aeb4a27fe667e7462918a: 2023-02-08 00:58:28,290 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:28,290 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:58:28,685 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family2/d0cf991cf5174844bda74325b9f34dc8 2023-02-08 00:58:28,686 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family2/479cc4f066f0415ab19e454360983796 2023-02-08 00:58:28,695 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family1/f28538b2d96b458c9e94d1487098428b as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/f28538b2d96b458c9e94d1487098428b 2023-02-08 00:58:28,696 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family1/181d16d9fb42455aa19a563ddb119b7a as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/181d16d9fb42455aa19a563ddb119b7a 2023-02-08 00:58:28,699 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/f28538b2d96b458c9e94d1487098428b, entries=4, sequenceid=13, filesize=5.4 K 2023-02-08 00:58:28,699 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/181d16d9fb42455aa19a563ddb119b7a, entries=4, sequenceid=13, filesize=5.4 K 2023-02-08 00:58:28,700 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family2/479cc4f066f0415ab19e454360983796 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/479cc4f066f0415ab19e454360983796 2023-02-08 00:58:28,700 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family2/d0cf991cf5174844bda74325b9f34dc8 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/d0cf991cf5174844bda74325b9f34dc8 2023-02-08 00:58:28,703 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/479cc4f066f0415ab19e454360983796, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 00:58:28,703 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/d0cf991cf5174844bda74325b9f34dc8, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 00:58:28,704 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 89a0ab87c56c5be47f5c7e5dcda828ee in 1677ms, sequenceid=13, compaction requested=true 2023-02-08 00:58:28,704 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 84c1293d4c4595b4d6d33cad2b445d99 in 1677ms, sequenceid=13, compaction requested=true 2023-02-08 00:58:28,704 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 89a0ab87c56c5be47f5c7e5dcda828ee: 2023-02-08 00:58:28,704 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 84c1293d4c4595b4d6d33cad2b445d99: 2023-02-08 00:58:28,704 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:28,704 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:28,704 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:58:28,704 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:58:28,704 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:58:28,704 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:28,704 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-08 00:58:28,704 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-08 00:58:28,787 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:28,787 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:28,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:28,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:28,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:28,788 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:28,788 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:58:28,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:28,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:28,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:28,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:28,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:28,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-08 00:58:28,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e372bc2[Count = 0] remaining members to acquire global barrier 2023-02-08 00:58:28,792 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-08 00:58:28,792 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:28,809 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:28,809 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:28,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:28,809 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-08 00:58:28,809 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-08 00:58:28,809 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:28,810 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:58:28,809 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:58:28,853 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:28,853 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-08 00:58:28,853 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:28,853 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-08 00:58:28,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:28,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:28,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:28,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:28,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:28,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:28,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:28,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:28,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:28,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:28,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:58:28,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-08 00:58:28,858 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-08 00:58:28,858 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:58:28,858 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:58:28,858 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-08 00:58:28,858 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:58:29,193 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:29,193 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:29,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:29,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:29,193 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:29,194 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:29,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:29,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:29,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:29,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:29,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:29,197 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:29,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:29,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:29,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:29,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:29,336 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:29,337 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:29,337 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:29,337 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:29,337 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-08 00:58:29,337 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:29,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-08 00:58:29,337 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:58:29,337 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:29,337 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:29,337 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:29,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:29,337 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:29,337 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-08 00:58:29,337 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:29,337 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:58:29,337 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:29,338 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:29,338 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:29,438 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:58:29,438 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:29,438 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:29,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:58:29,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:29,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:29,443 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:29,445 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:29,445 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:29,446 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:58:29,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-08 00:58:29,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-08 00:58:29,455 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-08 00:58:29,455 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:29,455 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-08 00:58:29,455 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-08 00:58:29,456 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:29,456 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:29,747 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:29,747 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:29,748 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:29,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:29,748 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:29,749 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:58:29,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:29,750 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:29,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:58:29,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:29,751 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-08 00:58:29,755 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-02-08 00:58:29,755 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-08 00:58:29,756 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-08 00:58:29,756 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:29,756 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-08 00:58:29,756 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:29,756 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. started... 2023-02-08 00:58:29,756 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:58:29,756 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:29,756 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9338368da41aeb4a27fe667e7462918a 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 00:58:29,756 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. started... 2023-02-08 00:58:29,756 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:58:29,756 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:29,757 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 89a0ab87c56c5be47f5c7e5dcda828ee 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 00:58:29,757 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. started... 2023-02-08 00:58:29,757 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 84c1293d4c4595b4d6d33cad2b445d99 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 00:58:30,173 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020841cb9609b27c496f8a67407d4465db85 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020841cb9609b27c496f8a67407d4465db85 2023-02-08 00:58:30,173 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208dfc96d73a32c440d97f8194d2e8a1603 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208dfc96d73a32c440d97f8194d2e8a1603 2023-02-08 00:58:30,173 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302080d56f61817aa499a8a6c700d5427677b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302080d56f61817aa499a8a6c700d5427677b 2023-02-08 00:58:30,578 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family1/1f4294965d164c09a938a95bffd4793b 2023-02-08 00:58:30,582 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family1/1d5c7a174bfa494e951b974776a92357 2023-02-08 00:58:30,583 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family1/b9a0140a3e384a57b168c92e212fcd4a 2023-02-08 00:58:30,982 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:58:31,000 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208605e41e5cc6e4246a71bfdf916124d21 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208605e41e5cc6e4246a71bfdf916124d21 2023-02-08 00:58:31,002 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302080c3a9519deef45a294f9588e6bdc6f73 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302080c3a9519deef45a294f9588e6bdc6f73 2023-02-08 00:58:31,004 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208da3b254f526447a99aa081c8bd65b2df to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208da3b254f526447a99aa081c8bd65b2df 2023-02-08 00:58:31,406 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family2/60b77def44d14713bd081b36d6327d3d 2023-02-08 00:58:31,411 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family1/1f4294965d164c09a938a95bffd4793b as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/1f4294965d164c09a938a95bffd4793b 2023-02-08 00:58:31,413 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family2/c6e5fe5a78024d3d8cb80ebde02be1eb 2023-02-08 00:58:31,418 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/1f4294965d164c09a938a95bffd4793b, entries=4, sequenceid=17, filesize=5.4 K 2023-02-08 00:58:31,419 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family2/60b77def44d14713bd081b36d6327d3d as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/60b77def44d14713bd081b36d6327d3d 2023-02-08 00:58:31,420 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family1/b9a0140a3e384a57b168c92e212fcd4a as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/b9a0140a3e384a57b168c92e212fcd4a 2023-02-08 00:58:31,423 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family2/f40a6c5592584a3984c2073283d7e5a3 2023-02-08 00:58:31,426 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/b9a0140a3e384a57b168c92e212fcd4a, entries=4, sequenceid=17, filesize=5.4 K 2023-02-08 00:58:31,426 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/60b77def44d14713bd081b36d6327d3d, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 00:58:31,427 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family2/c6e5fe5a78024d3d8cb80ebde02be1eb as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/c6e5fe5a78024d3d8cb80ebde02be1eb 2023-02-08 00:58:31,427 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 89a0ab87c56c5be47f5c7e5dcda828ee in 1670ms, sequenceid=17, compaction requested=true 2023-02-08 00:58:31,427 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 89a0ab87c56c5be47f5c7e5dcda828ee: 2023-02-08 00:58:31,427 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:31,427 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:58:31,429 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family1/1d5c7a174bfa494e951b974776a92357 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/1d5c7a174bfa494e951b974776a92357 2023-02-08 00:58:31,431 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/c6e5fe5a78024d3d8cb80ebde02be1eb, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 00:58:31,431 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 84c1293d4c4595b4d6d33cad2b445d99 in 1674ms, sequenceid=17, compaction requested=true 2023-02-08 00:58:31,431 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 84c1293d4c4595b4d6d33cad2b445d99: 2023-02-08 00:58:31,431 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:31,431 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:58:31,432 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/1d5c7a174bfa494e951b974776a92357, entries=4, sequenceid=17, filesize=5.4 K 2023-02-08 00:58:31,433 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family2/f40a6c5592584a3984c2073283d7e5a3 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/f40a6c5592584a3984c2073283d7e5a3 2023-02-08 00:58:31,437 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/f40a6c5592584a3984c2073283d7e5a3, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 00:58:31,438 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 9338368da41aeb4a27fe667e7462918a in 1682ms, sequenceid=17, compaction requested=true 2023-02-08 00:58:31,438 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9338368da41aeb4a27fe667e7462918a: 2023-02-08 00:58:31,438 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:31,438 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:58:31,438 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:58:31,438 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:31,438 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-08 00:58:31,438 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-08 00:58:31,673 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:31,673 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:31,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:31,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:31,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:31,674 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:31,674 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:58:31,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:31,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:31,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:31,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-08 00:58:31,677 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-08 00:58:31,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@64be023f[Count = 0] remaining members to acquire global barrier 2023-02-08 00:58:31,677 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:31,714 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:31,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:31,715 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-08 00:58:31,715 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-08 00:58:31,715 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:58:31,715 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:31,715 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:58:31,726 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:31,726 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-08 00:58:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:31,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:31,726 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:31,726 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-08 00:58:31,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:31,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:31,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:31,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:31,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:31,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:58:31,733 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-08 00:58:31,733 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:58:31,733 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:58:31,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-08 00:58:31,733 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-08 00:58:31,733 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:58:31,747 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:31,747 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:31,747 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:31,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:31,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:31,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:31,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:31,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:31,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:31,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:31,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:31,748 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:31,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:31,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:31,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:31,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:31,748 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:31,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:31,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:31,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:31,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:32,099 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:32,099 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:32,099 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:32,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-08 00:58:32,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:58:32,099 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:32,099 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:32,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:32,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:32,099 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:32,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-08 00:58:32,100 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-08 00:58:32,101 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:58:32,099 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:32,101 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:32,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:32,101 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:32,102 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:32,102 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:32,201 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:58:32,201 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:32,201 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:32,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:58:32,215 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:32,215 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:32,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1580): Client=jenkins//136.243.104.168 snapshot request for:{ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-08 00:58:32,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675817912216 (current time:1675817912216). 2023-02-08 00:58:32,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 00:58:32,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] zookeeper.ReadOnlyZKClient(139): Connect 0x4f85698f to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:58:32,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2dc0491, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:58:32,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:58:32,539 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:57076, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:58:32,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4f85698f to 127.0.0.1:49726 2023-02-08 00:58:32,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:58:32,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 00:58:32,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-08 00:58:32,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-08 00:58:32,549 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-08 00:58:32,550 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1675818512550 2023-02-08 00:58:32,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-08 00:58:32,550 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1675817912203 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-08 00:58:32,551 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-08 00:58:32,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] procedure2.ProcedureExecutor(1029): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-08 00:58:32,552 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 3 msec 2023-02-08 00:58:32,553 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-08 00:58:32,553 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1675818512553 2023-02-08 00:58:32,555 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-08 00:58:32,555 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 00:58:32,655 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 00:58:32,657 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:32,657 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:32,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 00:58:32,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 00:58:32,669 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 00:58:32,869 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 00:58:32,869 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:32,869 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:32,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 00:58:32,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 00:58:32,870 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-08 00:58:32,960 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1675817912203 2023-02-08 00:58:32,961 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1675817912203' 2023-02-08 00:58:32,961 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 00:58:32,961 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1675817912203' starting 'acquire' 2023-02-08 00:58:32,961 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1675817912203', kicking off acquire phase on members. 2023-02-08 00:58:32,961 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1675817912203 2023-02-08 00:58:32,961 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1675817912203 2023-02-08 00:58:33,171 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 00:58:33,171 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:33,171 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:33,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 00:58:33,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 00:58:33,173 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-08 00:58:33,225 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 00:58:33,225 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1675817912203/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 00:58:33,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 00:58:33,227 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1675817912203/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,227 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:58:33,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1675817912203 2023-02-08 00:58:33,228 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1675817912203 2023-02-08 00:58:33,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-02-08 00:58:33,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1675817912203 2023-02-08 00:58:33,230 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1675817912203 from table testCompactionWithHFileLink type FLUSH 2023-02-08 00:58:33,235 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1675817912203 2023-02-08 00:58:33,235 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1675817912203' with timeout 300000ms 2023-02-08 00:58:33,235 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-02-08 00:58:33,235 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1675817912203' starting 'acquire' stage 2023-02-08 00:58:33,235 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1675817912203' locally acquired 2023-02-08 00:58:33,235 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (snaptb-1675817912203) in zk 2023-02-08 00:58:33,241 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675817912203/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,241 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1675817912203 2023-02-08 00:58:33,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1675817912203/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:33,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 00:58:33,242 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1675817912203 2023-02-08 00:58:33,242 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1675817912203' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:58:33,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:33,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675817912203 2023-02-08 00:58:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:33,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'snaptb-1675817912203' on coordinator 2023-02-08 00:58:33,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a2f7a49[Count = 0] remaining members to acquire global barrier 2023-02-08 00:58:33,243 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1675817912203' starting 'in-barrier' execution. 2023-02-08 00:58:33,243 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1675817912203 2023-02-08 00:58:33,252 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675817912203 2023-02-08 00:58:33,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1675817912203 2023-02-08 00:58:33,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1675817912203 2023-02-08 00:58:33,252 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1675817912203' received 'reached' from coordinator. 2023-02-08 00:58:33,252 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1675817912203/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,252 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:58:33,253 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:33,254 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:33,254 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-02-08 00:58:33,254 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:33,254 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-02-08 00:58:33,254 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. started... 2023-02-08 00:58:33,254 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. started... 2023-02-08 00:58:33,254 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. started... 2023-02-08 00:58:33,254 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] regionserver.HRegion(2445): Flush status journal for 89a0ab87c56c5be47f5c7e5dcda828ee: 2023-02-08 00:58:33,254 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] regionserver.HRegion(2445): Flush status journal for 84c1293d4c4595b4d6d33cad2b445d99: 2023-02-08 00:58:33,254 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] regionserver.HRegion(2445): Flush status journal for 9338368da41aeb4a27fe667e7462918a: 2023-02-08 00:58:33,255 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.' region-info for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,255 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.' region-info for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,255 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.' region-info for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,392 INFO [regionserver/jenkins-hbase12:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-02-08 00:58:33,393 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x071f1a8c to 127.0.0.1:49726 2023-02-08 00:58:33,393 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:58:33,393 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:58:33,393 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4867b20d to 127.0.0.1:49726 2023-02-08 00:58:33,393 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:58:33,393 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:58:33,393 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03bfbd7b to 127.0.0.1:49726 2023-02-08 00:58:33,393 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:58:33,393 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:58:33,393 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x362457bf to 127.0.0.1:49726 2023-02-08 00:58:33,393 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:58:33,396 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 00:58:33,396 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 00:58:33,396 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-02-08 00:58:33,399 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/61f44948dce74812a54741846e65864f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/2711b734a9a54aeb873ac5781a17315b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/181d16d9fb42455aa19a563ddb119b7a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/b9a0140a3e384a57b168c92e212fcd4a] hfiles 2023-02-08 00:58:33,399 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/32ad3bac17fc4da182401fd0674b4161, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/914020f3714948679271bb1ac4014cbe, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a3ba9365b9d84749af18cbd50c81216b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/1d5c7a174bfa494e951b974776a92357] hfiles 2023-02-08 00:58:33,399 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/0b47b0d0ff374ba5a83918d6ec87722c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/157d1d946a37498ba85c679a775a8e5f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/f28538b2d96b458c9e94d1487098428b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/1f4294965d164c09a938a95bffd4793b] hfiles 2023-02-08 00:58:33,399 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/32ad3bac17fc4da182401fd0674b4161 for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,399 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/61f44948dce74812a54741846e65864f for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,399 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/0b47b0d0ff374ba5a83918d6ec87722c for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/914020f3714948679271bb1ac4014cbe for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a3ba9365b9d84749af18cbd50c81216b for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/1d5c7a174bfa494e951b974776a92357 for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/2711b734a9a54aeb873ac5781a17315b for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/157d1d946a37498ba85c679a775a8e5f for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/fb369dd9a58b499abdc4074a96c392a8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/96f0852960e949968254a73c25713b7f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/2e583228507e4466b431aef4d66e0550, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/f40a6c5592584a3984c2073283d7e5a3] hfiles 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/fb369dd9a58b499abdc4074a96c392a8 for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/96f0852960e949968254a73c25713b7f for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/181d16d9fb42455aa19a563ddb119b7a for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/b9a0140a3e384a57b168c92e212fcd4a for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/2e583228507e4466b431aef4d66e0550 for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/30ce6d15bc614f898acca9ea78c25ab0, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/f6708c31fcad404f87bd2d268f67f8a6, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/d0cf991cf5174844bda74325b9f34dc8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/c6e5fe5a78024d3d8cb80ebde02be1eb] hfiles 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/f28538b2d96b458c9e94d1487098428b for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/30ce6d15bc614f898acca9ea78c25ab0 for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/f40a6c5592584a3984c2073283d7e5a3 for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/f6708c31fcad404f87bd2d268f67f8a6 for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/1f4294965d164c09a938a95bffd4793b for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/d0cf991cf5174844bda74325b9f34dc8 for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/7248a2815e884b62be416154b778eb7b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/79201498d5624db5882d048fb42c97bf, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/479cc4f066f0415ab19e454360983796, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/60b77def44d14713bd081b36d6327d3d] hfiles 2023-02-08 00:58:33,402 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/c6e5fe5a78024d3d8cb80ebde02be1eb for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,403 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/7248a2815e884b62be416154b778eb7b for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,403 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/79201498d5624db5882d048fb42c97bf for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,403 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/479cc4f066f0415ab19e454360983796 for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,403 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/60b77def44d14713bd081b36d6327d3d for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,413 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. completed. 2023-02-08 00:58:33,413 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. completed. 2023-02-08 00:58:33,413 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:33,413 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. completed. 2023-02-08 00:58:33,413 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:33,413 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:33,414 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-02-08 00:58:33,414 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-02-08 00:58:33,414 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-02-08 00:58:33,414 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-02-08 00:58:33,414 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,414 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1675817912203' locally completed 2023-02-08 00:58:33,414 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1675817912203' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:58:33,673 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 00:58:33,674 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:33,674 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:33,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 00:58:33,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 00:58:33,677 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-08 00:58:33,851 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675817912203/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,851 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1675817912203' has notified controller of completion 2023-02-08 00:58:33,851 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:33,851 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1675817912203' completed. 2023-02-08 00:58:33,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1675817912203/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:33,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 00:58:33,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:33,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:33,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675817912203 2023-02-08 00:58:33,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:33,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675817912203 2023-02-08 00:58:33,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1675817912203' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:58:33,858 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'snaptb-1675817912203', counting down latch. Waiting for 0 more 2023-02-08 00:58:33,858 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1675817912203' execution completed 2023-02-08 00:58:33,858 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:58:33,858 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:58:33,858 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1675817912203 2023-02-08 00:58:33,858 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1675817912203including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-02-08 00:58:33,893 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675817912203 2023-02-08 00:58:33,893 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675817912203 2023-02-08 00:58:33,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1675817912203 2023-02-08 00:58:33,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:33,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-02-08 00:58:33,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1675817912203 2023-02-08 00:58:33,893 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 00:58:33,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1675817912203 2023-02-08 00:58:33,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:33,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 00:58:33,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 00:58:33,896 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1675817912203/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1675817912203 2023-02-08 00:58:33,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675817912203 2023-02-08 00:58:33,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:33,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675817912203 2023-02-08 00:58:33,900 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1675817912203/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:33,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1675817912203 2023-02-08 00:58:33,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,926 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-02-08 00:58:33,926 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-02-08 00:58:33,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-02-08 00:58:33,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1675817912203 2023-02-08 00:58:33,926 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675817912203/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,926 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:33,926 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-02-08 00:58:33,926 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675817912203 2023-02-08 00:58:33,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-02-08 00:58:33,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1675817912203 2023-02-08 00:58:33,926 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1675817912203 2023-02-08 00:58:33,926 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-02-08 00:58:33,926 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675817912203/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:33,926 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675817912203 2023-02-08 00:58:33,926 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1675817912203 2023-02-08 00:58:33,926 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1675817912203 2023-02-08 00:58:33,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-02-08 00:58:33,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-02-08 00:58:33,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302081b8a3787433e4edb8acf766920c2cd58, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208bee32da1c78040568b8d603fc9195d12, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208dfc96d73a32c440d97f8194d2e8a1603, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208fc9f29a8895f4095863045e0578d9bbc, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302080d56f61817aa499a8a6c700d5427677b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208634b7040b5f847b5bc9c60cf18a2a8c3, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208ab9f748451af4fc2955f7c9bad85c063, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208cfe0bba23e494aad8459db2f96458784, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020813f48f83788542e6a6b76968ab2feb40, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302083115e47f274a4d269d511449ed28dd95, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020841cb9609b27c496f8a67407d4465db85, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302086b17a8d7ccd645b2b72c8b5050e3ac1c] mob files 2023-02-08 00:58:33,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302081b8a3787433e4edb8acf766920c2cd58 2023-02-08 00:58:33,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208bee32da1c78040568b8d603fc9195d12 2023-02-08 00:58:33,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208dfc96d73a32c440d97f8194d2e8a1603 2023-02-08 00:58:33,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208fc9f29a8895f4095863045e0578d9bbc 2023-02-08 00:58:33,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302080d56f61817aa499a8a6c700d5427677b 2023-02-08 00:58:33,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208634b7040b5f847b5bc9c60cf18a2a8c3 2023-02-08 00:58:33,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208ab9f748451af4fc2955f7c9bad85c063 2023-02-08 00:58:33,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208cfe0bba23e494aad8459db2f96458784 2023-02-08 00:58:33,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020813f48f83788542e6a6b76968ab2feb40 2023-02-08 00:58:33,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302083115e47f274a4d269d511449ed28dd95 2023-02-08 00:58:33,928 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020841cb9609b27c496f8a67407d4465db85 2023-02-08 00:58:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302086b17a8d7ccd645b2b72c8b5050e3ac1c 2023-02-08 00:58:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020821528418aaf9477e92907e8ec449a337, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020833a33c13ac654a35ac6d3ca7e9a9edf1, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302086f4ce6fa80f94dd1b3fe89261efb03cd, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208da3b254f526447a99aa081c8bd65b2df, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302080c3a9519deef45a294f9588e6bdc6f73, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302081e6a0735946344caacd20b5274d0f3af, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208517de1d54dd442e8bc8bd34da4d0c697, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208a5a2b190b2c84b328d97038f63fcf2cc, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302083ea0c834f4ae49b4bb92308e8e5677b9, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208605e41e5cc6e4246a71bfdf916124d21, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208bef91af772c44e37919c302ef0a67f9b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208c39437fd949e4f099ddea261ae0acbd0] mob files 2023-02-08 00:58:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020821528418aaf9477e92907e8ec449a337 2023-02-08 00:58:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020833a33c13ac654a35ac6d3ca7e9a9edf1 2023-02-08 00:58:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302086f4ce6fa80f94dd1b3fe89261efb03cd 2023-02-08 00:58:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208da3b254f526447a99aa081c8bd65b2df 2023-02-08 00:58:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302080c3a9519deef45a294f9588e6bdc6f73 2023-02-08 00:58:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302081e6a0735946344caacd20b5274d0f3af 2023-02-08 00:58:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208517de1d54dd442e8bc8bd34da4d0c697 2023-02-08 00:58:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208a5a2b190b2c84b328d97038f63fcf2cc 2023-02-08 00:58:33,929 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302083ea0c834f4ae49b4bb92308e8e5677b9 2023-02-08 00:58:33,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208605e41e5cc6e4246a71bfdf916124d21 2023-02-08 00:58:33,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208bef91af772c44e37919c302ef0a67f9b 2023-02-08 00:58:33,930 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208c39437fd949e4f099ddea261ae0acbd0 2023-02-08 00:58:34,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1675817912203 2023-02-08 00:58:34,336 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.hbase-snapshot/.tmp/snaptb-1675817912203 2023-02-08 00:58:34,677 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 00:58:34,678 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:34,678 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:34,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 00:58:34,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 00:58:34,679 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2428): (#6) Sleeping: 2000ms while waiting for snapshot completion. 2023-02-08 00:58:34,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.hbase-snapshot/.tmp/snaptb-1675817912203 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.hbase-snapshot/snaptb-1675817912203 2023-02-08 00:58:35,601 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1675817912203 of table testCompactionWithHFileLink completed 2023-02-08 00:58:35,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.hbase-snapshot/.tmp/snaptb-1675817912203 2023-02-08 00:58:35,601 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.hbase-snapshot/.tmp/snaptb-1675817912203 2023-02-08 00:58:35,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1675817912203 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1675817912551Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1675817914334 (+1783 ms)Consolidate snapshot: snaptb-1675817912203 at 1675817914334Loading Region manifests for snaptb-1675817912203 at 1675817914334Writing data manifest for snaptb-1675817912203 at 1675817914343 (+9 ms)Verifying snapshot: snaptb-1675817912203 at 1675817914754 (+411 ms)Snapshot snaptb-1675817912203 of table testCompactionWithHFileLink completed at 1675817915601 (+847 ms) 2023-02-08 00:58:35,603 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-02-08 00:58:35,605 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 3.0510 sec 2023-02-08 00:58:36,679 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 00:58:36,679 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:36,679 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:36,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 00:58:36,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 00:58:36,726 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:36,726 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:36,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:58:36,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-02-08 00:58:36,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-02-08 00:58:36,729 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-02-08 00:58:36,729 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:36,729 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-02-08 00:58:36,729 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-02-08 00:58:36,729 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:36,729 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:36,904 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:36,904 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:36,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:36,905 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:36,905 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:58:36,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:36,906 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:58:36,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:36,907 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-02-08 00:58:36,907 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-02-08 00:58:36,908 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-02-08 00:58:36,908 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:36,908 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-02-08 00:58:36,908 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:36,908 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. started... 2023-02-08 00:58:36,908 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:36,908 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 9338368da41aeb4a27fe667e7462918a 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 00:58:36,908 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:36,908 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. started... 2023-02-08 00:58:36,908 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:58:36,909 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 89a0ab87c56c5be47f5c7e5dcda828ee 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 00:58:36,909 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:58:36,908 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. started... 2023-02-08 00:58:36,909 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 84c1293d4c4595b4d6d33cad2b445d99 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 00:58:37,749 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family1/0039eb24fd204d01b3436732cfba800b 2023-02-08 00:58:37,752 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family1/cd80172641f948d5a6fb0f4c32025c44 2023-02-08 00:58:37,752 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family1/3de03a6798c540b88cdbe3bea7e8bf5f 2023-02-08 00:58:37,758 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0039eb24fd204d01b3436732cfba800b 2023-02-08 00:58:37,759 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cd80172641f948d5a6fb0f4c32025c44 2023-02-08 00:58:37,760 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3de03a6798c540b88cdbe3bea7e8bf5f 2023-02-08 00:58:38,581 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family2/7f32e85c95414b79af1f6be65dd141c6 2023-02-08 00:58:38,587 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family2/dc2ed6401fba41ccb8a576d12bec8a4e 2023-02-08 00:58:38,587 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f32e85c95414b79af1f6be65dd141c6 2023-02-08 00:58:38,588 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family2/0ab03f49cc1c44229e9f7d75d7b7d3e5 2023-02-08 00:58:38,589 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family1/0039eb24fd204d01b3436732cfba800b as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/0039eb24fd204d01b3436732cfba800b 2023-02-08 00:58:38,595 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc2ed6401fba41ccb8a576d12bec8a4e 2023-02-08 00:58:38,596 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family1/cd80172641f948d5a6fb0f4c32025c44 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/cd80172641f948d5a6fb0f4c32025c44 2023-02-08 00:58:38,596 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0039eb24fd204d01b3436732cfba800b 2023-02-08 00:58:38,596 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/0039eb24fd204d01b3436732cfba800b, entries=3, sequenceid=24, filesize=5.0 K 2023-02-08 00:58:38,597 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family2/7f32e85c95414b79af1f6be65dd141c6 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/7f32e85c95414b79af1f6be65dd141c6 2023-02-08 00:58:38,597 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ab03f49cc1c44229e9f7d75d7b7d3e5 2023-02-08 00:58:38,598 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family1/3de03a6798c540b88cdbe3bea7e8bf5f as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/3de03a6798c540b88cdbe3bea7e8bf5f 2023-02-08 00:58:38,600 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cd80172641f948d5a6fb0f4c32025c44 2023-02-08 00:58:38,600 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/cd80172641f948d5a6fb0f4c32025c44, entries=3, sequenceid=24, filesize=5.0 K 2023-02-08 00:58:38,601 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family2/dc2ed6401fba41ccb8a576d12bec8a4e as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/dc2ed6401fba41ccb8a576d12bec8a4e 2023-02-08 00:58:38,601 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f32e85c95414b79af1f6be65dd141c6 2023-02-08 00:58:38,601 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/7f32e85c95414b79af1f6be65dd141c6, entries=1, sequenceid=24, filesize=5.0 K 2023-02-08 00:58:38,602 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 89a0ab87c56c5be47f5c7e5dcda828ee in 1693ms, sequenceid=24, compaction requested=true 2023-02-08 00:58:38,602 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 89a0ab87c56c5be47f5c7e5dcda828ee: 2023-02-08 00:58:38,602 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:38,602 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3de03a6798c540b88cdbe3bea7e8bf5f 2023-02-08 00:58:38,602 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:58:38,602 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/3de03a6798c540b88cdbe3bea7e8bf5f, entries=3, sequenceid=24, filesize=5.0 K 2023-02-08 00:58:38,603 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family2/0ab03f49cc1c44229e9f7d75d7b7d3e5 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/0ab03f49cc1c44229e9f7d75d7b7d3e5 2023-02-08 00:58:38,606 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc2ed6401fba41ccb8a576d12bec8a4e 2023-02-08 00:58:38,606 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/dc2ed6401fba41ccb8a576d12bec8a4e, entries=1, sequenceid=24, filesize=5.0 K 2023-02-08 00:58:38,606 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0ab03f49cc1c44229e9f7d75d7b7d3e5 2023-02-08 00:58:38,606 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/0ab03f49cc1c44229e9f7d75d7b7d3e5, entries=1, sequenceid=24, filesize=5.0 K 2023-02-08 00:58:38,606 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 9338368da41aeb4a27fe667e7462918a in 1698ms, sequenceid=24, compaction requested=true 2023-02-08 00:58:38,606 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 84c1293d4c4595b4d6d33cad2b445d99 in 1697ms, sequenceid=24, compaction requested=true 2023-02-08 00:58:38,606 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 9338368da41aeb4a27fe667e7462918a: 2023-02-08 00:58:38,607 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 84c1293d4c4595b4d6d33cad2b445d99: 2023-02-08 00:58:38,607 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:38,607 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:38,607 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:58:38,607 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:58:38,607 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:58:38,607 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:38,607 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-02-08 00:58:38,607 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-02-08 00:58:38,907 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:38,907 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:38,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:38,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:38,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:38,907 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:38,907 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:58:38,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:38,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:38,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:38,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:38,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:38,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-02-08 00:58:38,911 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-02-08 00:58:38,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fb266c5[Count = 0] remaining members to acquire global barrier 2023-02-08 00:58:38,911 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:39,174 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:39,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:39,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:39,175 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-02-08 00:58:39,175 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:39,175 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:58:39,175 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-02-08 00:58:39,175 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:58:39,209 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-02-08 00:58:39,210 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:39,210 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:39,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:39,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:39,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:39,210 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-02-08 00:58:39,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:39,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:39,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:39,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:39,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:39,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:39,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:39,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:58:39,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-02-08 00:58:39,212 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-02-08 00:58:39,212 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:58:39,212 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:58:39,213 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-02-08 00:58:39,213 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:58:39,228 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:39,228 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:39,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:39,228 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:39,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:39,228 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:39,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:39,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:39,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:39,229 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:39,229 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:39,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:39,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:39,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-02-08 00:58:39,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:39,577 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:39,577 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:39,577 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:39,577 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:39,577 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-02-08 00:58:39,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-02-08 00:58:39,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:58:39,577 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-02-08 00:58:39,578 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:39,578 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:39,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:39,578 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:39,578 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-02-08 00:58:39,578 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:58:39,578 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:39,579 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-02-08 00:58:39,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:39,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:39,579 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-02-08 00:58:39,679 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:58:39,679 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:39,679 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:39,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:58:39,682 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:58:39,682 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): 9338368da41aeb4a27fe667e7462918a/family1 is initiating major compaction (all files) 2023-02-08 00:58:39,683 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:58:39,683 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:58:39,683 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of 9338368da41aeb4a27fe667e7462918a/family1 in testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:39,684 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/32ad3bac17fc4da182401fd0674b4161, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/914020f3714948679271bb1ac4014cbe, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a3ba9365b9d84749af18cbd50c81216b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/1d5c7a174bfa494e951b974776a92357, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/cd80172641f948d5a6fb0f4c32025c44] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp, totalSize=26.7 K 2023-02-08 00:58:39,685 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 32ad3bac17fc4da182401fd0674b4161, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817901008 2023-02-08 00:58:39,685 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 914020f3714948679271bb1ac4014cbe, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817903799 2023-02-08 00:58:39,685 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting a3ba9365b9d84749af18cbd50c81216b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817906750 2023-02-08 00:58:39,686 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 1d5c7a174bfa494e951b974776a92357, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817909443 2023-02-08 00:58:39,686 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting cd80172641f948d5a6fb0f4c32025c44, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-08 00:58:39,701 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): 9338368da41aeb4a27fe667e7462918a#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:58:40,114 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230208bb34695cb98d447ba4837c1ede1cdd6f_del 2023-02-08 00:58:40,114 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208bb34695cb98d447ba4837c1ede1cdd6f_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208bb34695cb98d447ba4837c1ede1cdd6f_del 2023-02-08 00:58:40,935 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6786426ee6f24a7e955c0c3a59939284 2023-02-08 00:58:40,936 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family1/6786426ee6f24a7e955c0c3a59939284 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/6786426ee6f24a7e955c0c3a59939284 2023-02-08 00:58:40,940 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6786426ee6f24a7e955c0c3a59939284 2023-02-08 00:58:40,940 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9338368da41aeb4a27fe667e7462918a/family1 of 9338368da41aeb4a27fe667e7462918a into 6786426ee6f24a7e955c0c3a59939284(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:58:40,941 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for 9338368da41aeb4a27fe667e7462918a: 2023-02-08 00:58:40,941 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:58:40,941 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): 9338368da41aeb4a27fe667e7462918a/family2 is initiating major compaction (all files) 2023-02-08 00:58:40,941 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:58:40,941 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:58:40,941 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of 9338368da41aeb4a27fe667e7462918a/family2 in testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:40,941 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/fb369dd9a58b499abdc4074a96c392a8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/96f0852960e949968254a73c25713b7f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/2e583228507e4466b431aef4d66e0550, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/f40a6c5592584a3984c2073283d7e5a3, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/dc2ed6401fba41ccb8a576d12bec8a4e] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp, totalSize=25.4 K 2023-02-08 00:58:40,942 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting fb369dd9a58b499abdc4074a96c392a8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817901008 2023-02-08 00:58:40,942 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 96f0852960e949968254a73c25713b7f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817903799 2023-02-08 00:58:40,943 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 2e583228507e4466b431aef4d66e0550, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817906750 2023-02-08 00:58:40,943 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting f40a6c5592584a3984c2073283d7e5a3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817909443 2023-02-08 00:58:40,943 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting dc2ed6401fba41ccb8a576d12bec8a4e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-08 00:58:40,957 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): 9338368da41aeb4a27fe667e7462918a#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:58:40,999 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/32ad3bac17fc4da182401fd0674b4161, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/914020f3714948679271bb1ac4014cbe, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a3ba9365b9d84749af18cbd50c81216b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/1d5c7a174bfa494e951b974776a92357, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/cd80172641f948d5a6fb0f4c32025c44] to archive 2023-02-08 00:58:41,000 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:41,001 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/32ad3bac17fc4da182401fd0674b4161 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/32ad3bac17fc4da182401fd0674b4161 2023-02-08 00:58:41,002 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/914020f3714948679271bb1ac4014cbe to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/914020f3714948679271bb1ac4014cbe 2023-02-08 00:58:41,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a3ba9365b9d84749af18cbd50c81216b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a3ba9365b9d84749af18cbd50c81216b 2023-02-08 00:58:41,004 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/1d5c7a174bfa494e951b974776a92357 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/1d5c7a174bfa494e951b974776a92357 2023-02-08 00:58:41,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/cd80172641f948d5a6fb0f4c32025c44 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/cd80172641f948d5a6fb0f4c32025c44 2023-02-08 00:58:41,374 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230208a004bcccce0f46c5bc4ef5c54b932908_del 2023-02-08 00:58:41,374 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208a004bcccce0f46c5bc4ef5c54b932908_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208a004bcccce0f46c5bc4ef5c54b932908_del 2023-02-08 00:58:42,199 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0477dda8cba54a60b654071064fee73b 2023-02-08 00:58:42,199 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family2/0477dda8cba54a60b654071064fee73b as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/0477dda8cba54a60b654071064fee73b 2023-02-08 00:58:42,203 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0477dda8cba54a60b654071064fee73b 2023-02-08 00:58:42,204 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 9338368da41aeb4a27fe667e7462918a/family2 of 9338368da41aeb4a27fe667e7462918a into 0477dda8cba54a60b654071064fee73b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:58:42,204 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for 9338368da41aeb4a27fe667e7462918a: 2023-02-08 00:58:42,204 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:58:42,204 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): 84c1293d4c4595b4d6d33cad2b445d99/family1 is initiating major compaction (all files) 2023-02-08 00:58:42,204 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:58:42,204 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:58:42,204 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of 84c1293d4c4595b4d6d33cad2b445d99/family1 in testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:42,204 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/61f44948dce74812a54741846e65864f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/2711b734a9a54aeb873ac5781a17315b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/181d16d9fb42455aa19a563ddb119b7a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/b9a0140a3e384a57b168c92e212fcd4a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/3de03a6798c540b88cdbe3bea7e8bf5f] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp, totalSize=26.7 K 2023-02-08 00:58:42,205 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 61f44948dce74812a54741846e65864f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817901009 2023-02-08 00:58:42,205 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 2711b734a9a54aeb873ac5781a17315b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817903799 2023-02-08 00:58:42,205 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 181d16d9fb42455aa19a563ddb119b7a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817906751 2023-02-08 00:58:42,206 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting b9a0140a3e384a57b168c92e212fcd4a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817909443 2023-02-08 00:58:42,206 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 3de03a6798c540b88cdbe3bea7e8bf5f, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-08 00:58:42,216 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): 84c1293d4c4595b4d6d33cad2b445d99#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:58:42,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/fb369dd9a58b499abdc4074a96c392a8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/96f0852960e949968254a73c25713b7f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/2e583228507e4466b431aef4d66e0550, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/f40a6c5592584a3984c2073283d7e5a3, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/dc2ed6401fba41ccb8a576d12bec8a4e] to archive 2023-02-08 00:58:42,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:42,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/fb369dd9a58b499abdc4074a96c392a8 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/fb369dd9a58b499abdc4074a96c392a8 2023-02-08 00:58:42,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/96f0852960e949968254a73c25713b7f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/96f0852960e949968254a73c25713b7f 2023-02-08 00:58:42,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/2e583228507e4466b431aef4d66e0550 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/2e583228507e4466b431aef4d66e0550 2023-02-08 00:58:42,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/f40a6c5592584a3984c2073283d7e5a3 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/f40a6c5592584a3984c2073283d7e5a3 2023-02-08 00:58:42,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/dc2ed6401fba41ccb8a576d12bec8a4e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/dc2ed6401fba41ccb8a576d12bec8a4e 2023-02-08 00:58:42,623 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020827859d3148c645489d82a0b7cc98b41b_del 2023-02-08 00:58:42,623 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020827859d3148c645489d82a0b7cc98b41b_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020827859d3148c645489d82a0b7cc98b41b_del 2023-02-08 00:58:43,449 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1027d5212c7242ab83e28e2acdaa3f14 2023-02-08 00:58:43,451 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family1/1027d5212c7242ab83e28e2acdaa3f14 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/1027d5212c7242ab83e28e2acdaa3f14 2023-02-08 00:58:43,455 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1027d5212c7242ab83e28e2acdaa3f14 2023-02-08 00:58:43,456 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 84c1293d4c4595b4d6d33cad2b445d99/family1 of 84c1293d4c4595b4d6d33cad2b445d99 into 1027d5212c7242ab83e28e2acdaa3f14(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:58:43,456 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for 84c1293d4c4595b4d6d33cad2b445d99: 2023-02-08 00:58:43,456 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:58:43,456 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): 84c1293d4c4595b4d6d33cad2b445d99/family2 is initiating major compaction (all files) 2023-02-08 00:58:43,456 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:58:43,456 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:58:43,456 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of 84c1293d4c4595b4d6d33cad2b445d99/family2 in testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:43,456 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/30ce6d15bc614f898acca9ea78c25ab0, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/f6708c31fcad404f87bd2d268f67f8a6, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/d0cf991cf5174844bda74325b9f34dc8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/c6e5fe5a78024d3d8cb80ebde02be1eb, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/0ab03f49cc1c44229e9f7d75d7b7d3e5] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp, totalSize=25.4 K 2023-02-08 00:58:43,457 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 30ce6d15bc614f898acca9ea78c25ab0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817901009 2023-02-08 00:58:43,457 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting f6708c31fcad404f87bd2d268f67f8a6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817903799 2023-02-08 00:58:43,457 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting d0cf991cf5174844bda74325b9f34dc8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817906751 2023-02-08 00:58:43,458 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting c6e5fe5a78024d3d8cb80ebde02be1eb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817909443 2023-02-08 00:58:43,458 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 0ab03f49cc1c44229e9f7d75d7b7d3e5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-08 00:58:43,473 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): 84c1293d4c4595b4d6d33cad2b445d99#family2#compaction#111 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:58:43,481 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230208facf3bdc6fa641a68d4df900bcffadb4_del 2023-02-08 00:58:43,481 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208facf3bdc6fa641a68d4df900bcffadb4_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208facf3bdc6fa641a68d4df900bcffadb4_del 2023-02-08 00:58:43,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/61f44948dce74812a54741846e65864f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/2711b734a9a54aeb873ac5781a17315b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/181d16d9fb42455aa19a563ddb119b7a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/b9a0140a3e384a57b168c92e212fcd4a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/3de03a6798c540b88cdbe3bea7e8bf5f] to archive 2023-02-08 00:58:43,497 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:43,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/61f44948dce74812a54741846e65864f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/61f44948dce74812a54741846e65864f 2023-02-08 00:58:43,499 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/2711b734a9a54aeb873ac5781a17315b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/2711b734a9a54aeb873ac5781a17315b 2023-02-08 00:58:43,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/181d16d9fb42455aa19a563ddb119b7a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/181d16d9fb42455aa19a563ddb119b7a 2023-02-08 00:58:43,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/b9a0140a3e384a57b168c92e212fcd4a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/b9a0140a3e384a57b168c92e212fcd4a 2023-02-08 00:58:43,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/3de03a6798c540b88cdbe3bea7e8bf5f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/3de03a6798c540b88cdbe3bea7e8bf5f 2023-02-08 00:58:44,295 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 221dd4f5d0af419a9edb95596180b9a3 2023-02-08 00:58:44,296 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family2/221dd4f5d0af419a9edb95596180b9a3 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/221dd4f5d0af419a9edb95596180b9a3 2023-02-08 00:58:44,301 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 221dd4f5d0af419a9edb95596180b9a3 2023-02-08 00:58:44,302 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 84c1293d4c4595b4d6d33cad2b445d99/family2 of 84c1293d4c4595b4d6d33cad2b445d99 into 221dd4f5d0af419a9edb95596180b9a3(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:58:44,302 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for 84c1293d4c4595b4d6d33cad2b445d99: 2023-02-08 00:58:44,302 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:58:44,302 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): 89a0ab87c56c5be47f5c7e5dcda828ee/family1 is initiating major compaction (all files) 2023-02-08 00:58:44,303 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:58:44,303 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:58:44,303 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of 89a0ab87c56c5be47f5c7e5dcda828ee/family1 in testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:44,304 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/0b47b0d0ff374ba5a83918d6ec87722c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/157d1d946a37498ba85c679a775a8e5f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/f28538b2d96b458c9e94d1487098428b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/1f4294965d164c09a938a95bffd4793b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/0039eb24fd204d01b3436732cfba800b] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp, totalSize=26.7 K 2023-02-08 00:58:44,304 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 0b47b0d0ff374ba5a83918d6ec87722c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817901007 2023-02-08 00:58:44,305 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 157d1d946a37498ba85c679a775a8e5f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817903799 2023-02-08 00:58:44,305 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting f28538b2d96b458c9e94d1487098428b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817906750 2023-02-08 00:58:44,306 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 1f4294965d164c09a938a95bffd4793b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817909442 2023-02-08 00:58:44,306 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 0039eb24fd204d01b3436732cfba800b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-08 00:58:44,316 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): 89a0ab87c56c5be47f5c7e5dcda828ee#family1#compaction#112 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:58:44,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/30ce6d15bc614f898acca9ea78c25ab0, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/f6708c31fcad404f87bd2d268f67f8a6, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/d0cf991cf5174844bda74325b9f34dc8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/c6e5fe5a78024d3d8cb80ebde02be1eb, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/0ab03f49cc1c44229e9f7d75d7b7d3e5] to archive 2023-02-08 00:58:44,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:44,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/30ce6d15bc614f898acca9ea78c25ab0 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/30ce6d15bc614f898acca9ea78c25ab0 2023-02-08 00:58:44,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/f6708c31fcad404f87bd2d268f67f8a6 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/f6708c31fcad404f87bd2d268f67f8a6 2023-02-08 00:58:44,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/d0cf991cf5174844bda74325b9f34dc8 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/d0cf991cf5174844bda74325b9f34dc8 2023-02-08 00:58:44,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/c6e5fe5a78024d3d8cb80ebde02be1eb to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/c6e5fe5a78024d3d8cb80ebde02be1eb 2023-02-08 00:58:44,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/0ab03f49cc1c44229e9f7d75d7b7d3e5 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/0ab03f49cc1c44229e9f7d75d7b7d3e5 2023-02-08 00:58:44,726 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230208d96ef305ed9d45699780f2643a2c8e0c_del 2023-02-08 00:58:44,726 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208d96ef305ed9d45699780f2643a2c8e0c_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208d96ef305ed9d45699780f2643a2c8e0c_del 2023-02-08 00:58:45,552 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45dcc72eb55c467a9dccb6f53f0f4217 2023-02-08 00:58:45,553 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family1/45dcc72eb55c467a9dccb6f53f0f4217 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/45dcc72eb55c467a9dccb6f53f0f4217 2023-02-08 00:58:45,558 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45dcc72eb55c467a9dccb6f53f0f4217 2023-02-08 00:58:45,559 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 89a0ab87c56c5be47f5c7e5dcda828ee/family1 of 89a0ab87c56c5be47f5c7e5dcda828ee into 45dcc72eb55c467a9dccb6f53f0f4217(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:58:45,559 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for 89a0ab87c56c5be47f5c7e5dcda828ee: 2023-02-08 00:58:45,560 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:58:45,560 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): 89a0ab87c56c5be47f5c7e5dcda828ee/family2 is initiating major compaction (all files) 2023-02-08 00:58:45,560 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:58:45,560 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:58:45,561 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of 89a0ab87c56c5be47f5c7e5dcda828ee/family2 in testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:45,561 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/7248a2815e884b62be416154b778eb7b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/79201498d5624db5882d048fb42c97bf, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/479cc4f066f0415ab19e454360983796, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/60b77def44d14713bd081b36d6327d3d, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/7f32e85c95414b79af1f6be65dd141c6] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp, totalSize=25.4 K 2023-02-08 00:58:45,562 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 7248a2815e884b62be416154b778eb7b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817901007 2023-02-08 00:58:45,562 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 79201498d5624db5882d048fb42c97bf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817903799 2023-02-08 00:58:45,563 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 479cc4f066f0415ab19e454360983796, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817906750 2023-02-08 00:58:45,563 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 60b77def44d14713bd081b36d6327d3d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817909442 2023-02-08 00:58:45,564 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 7f32e85c95414b79af1f6be65dd141c6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-02-08 00:58:45,581 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): 89a0ab87c56c5be47f5c7e5dcda828ee#family2#compaction#113 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:58:45,588 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302087ad84c17c2514de0bf1d1f6150d14c2a_del 2023-02-08 00:58:45,589 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302087ad84c17c2514de0bf1d1f6150d14c2a_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302087ad84c17c2514de0bf1d1f6150d14c2a_del 2023-02-08 00:58:45,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/0b47b0d0ff374ba5a83918d6ec87722c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/157d1d946a37498ba85c679a775a8e5f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/f28538b2d96b458c9e94d1487098428b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/1f4294965d164c09a938a95bffd4793b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/0039eb24fd204d01b3436732cfba800b] to archive 2023-02-08 00:58:45,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:45,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/0b47b0d0ff374ba5a83918d6ec87722c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/0b47b0d0ff374ba5a83918d6ec87722c 2023-02-08 00:58:45,602 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/157d1d946a37498ba85c679a775a8e5f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/157d1d946a37498ba85c679a775a8e5f 2023-02-08 00:58:45,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/f28538b2d96b458c9e94d1487098428b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/f28538b2d96b458c9e94d1487098428b 2023-02-08 00:58:45,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/1f4294965d164c09a938a95bffd4793b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/1f4294965d164c09a938a95bffd4793b 2023-02-08 00:58:45,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/0039eb24fd204d01b3436732cfba800b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/0039eb24fd204d01b3436732cfba800b 2023-02-08 00:58:46,022 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35cad19271554a0e95d7c71ac10ea121 2023-02-08 00:58:46,024 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family2/35cad19271554a0e95d7c71ac10ea121 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/35cad19271554a0e95d7c71ac10ea121 2023-02-08 00:58:46,031 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35cad19271554a0e95d7c71ac10ea121 2023-02-08 00:58:46,032 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 89a0ab87c56c5be47f5c7e5dcda828ee/family2 of 89a0ab87c56c5be47f5c7e5dcda828ee into 35cad19271554a0e95d7c71ac10ea121(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:58:46,032 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for 89a0ab87c56c5be47f5c7e5dcda828ee: 2023-02-08 00:58:46,041 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:58:46,044 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:58:46,047 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:58:46,048 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:58:46,056 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-08 00:58:46,088 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-08 00:58:46,091 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230208d96ef305ed9d45699780f2643a2c8e0c_del 2023-02-08 00:58:46,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/7248a2815e884b62be416154b778eb7b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/79201498d5624db5882d048fb42c97bf, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/479cc4f066f0415ab19e454360983796, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/60b77def44d14713bd081b36d6327d3d, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/7f32e85c95414b79af1f6be65dd141c6] to archive 2023-02-08 00:58:46,100 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230208bb34695cb98d447ba4837c1ede1cdd6f_del 2023-02-08 00:58:46,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:46,102 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/7248a2815e884b62be416154b778eb7b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/7248a2815e884b62be416154b778eb7b 2023-02-08 00:58:46,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/79201498d5624db5882d048fb42c97bf to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/79201498d5624db5882d048fb42c97bf 2023-02-08 00:58:46,103 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020827859d3148c645489d82a0b7cc98b41b_del 2023-02-08 00:58:46,103 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:46,104 DEBUG [Listener at localhost.localdomain/36213] zookeeper.ReadOnlyZKClient(139): Connect 0x534804c5 to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:58:46,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/479cc4f066f0415ab19e454360983796 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/479cc4f066f0415ab19e454360983796 2023-02-08 00:58:46,107 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/60b77def44d14713bd081b36d6327d3d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/60b77def44d14713bd081b36d6327d3d 2023-02-08 00:58:46,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/7f32e85c95414b79af1f6be65dd141c6 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/7f32e85c95414b79af1f6be65dd141c6 2023-02-08 00:58:46,145 DEBUG [Listener at localhost.localdomain/36213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ed4688, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:58:46,145 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 00:58:46,146 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 00:58:46,146 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 00:58:46,628 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208fb67611c18ab4a40ba89fc409072cb7b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208fb67611c18ab4a40ba89fc409072cb7b 2023-02-08 00:58:46,629 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:46,640 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:58:46,643 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:56284, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:58:46,648 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:46,648 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:46,649 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:58:46,651 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:50804, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:58:46,662 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/7d7c9a1814d84000bea949faee88b05e first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-08 00:58:46,662 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/7d7c9a1814d84000bea949faee88b05e}] 2023-02-08 00:58:46,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/7d7c9a1814d84000bea949faee88b05e for inclusion in 89a0ab87c56c5be47f5c7e5dcda828ee/family1 2023-02-08 00:58:46,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-08 00:58:46,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last=1 2023-02-08 00:58:46,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 89a0ab87c56c5be47f5c7e5dcda828ee: 2023-02-08 00:58:46,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/7d7c9a1814d84000bea949faee88b05e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__hmophi9qa14v847740vj1a8g9lf89ucbanc22ui7lhjrc3a7etd1tm7bsrtkl1hn/family1/7d7c9a1814d84000bea949faee88b05e 2023-02-08 00:58:46,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__hmophi9qa14v847740vj1a8g9lf89ucbanc22ui7lhjrc3a7etd1tm7bsrtkl1hn/family1/7d7c9a1814d84000bea949faee88b05e as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/a7d3455ec17f4d319d979e1d1a80f918_SeqId_29_ 2023-02-08 00:58:46,673 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__hmophi9qa14v847740vj1a8g9lf89ucbanc22ui7lhjrc3a7etd1tm7bsrtkl1hn/family1/7d7c9a1814d84000bea949faee88b05e into 89a0ab87c56c5be47f5c7e5dcda828ee/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/a7d3455ec17f4d319d979e1d1a80f918_SeqId_29_ - updating store file list. 2023-02-08 00:58:46,676 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/a7d3455ec17f4d319d979e1d1a80f918_SeqId_29_ into 89a0ab87c56c5be47f5c7e5dcda828ee/family1 2023-02-08 00:58:46,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__hmophi9qa14v847740vj1a8g9lf89ucbanc22ui7lhjrc3a7etd1tm7bsrtkl1hn/family1/7d7c9a1814d84000bea949faee88b05e into 89a0ab87c56c5be47f5c7e5dcda828ee/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/a7d3455ec17f4d319d979e1d1a80f918_SeqId_29_) 2023-02-08 00:58:46,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__hmophi9qa14v847740vj1a8g9lf89ucbanc22ui7lhjrc3a7etd1tm7bsrtkl1hn/family1/7d7c9a1814d84000bea949faee88b05e 2023-02-08 00:58:46,679 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:46,680 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:46,681 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020813f48f83788542e6a6b76968ab2feb40 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020813f48f83788542e6a6b76968ab2feb40 2023-02-08 00:58:46,682 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302083115e47f274a4d269d511449ed28dd95 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302083115e47f274a4d269d511449ed28dd95 2023-02-08 00:58:46,682 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020841cb9609b27c496f8a67407d4465db85 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020841cb9609b27c496f8a67407d4465db85 2023-02-08 00:58:46,683 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302086b17a8d7ccd645b2b72c8b5050e3ac1c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202302086b17a8d7ccd645b2b72c8b5050e3ac1c 2023-02-08 00:58:46,683 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-08 00:58:46,683 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208' 2023-02-08 00:58:46,683 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 00:58:47,037 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302085a8a4959813041a8868f908de87854c7 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302085a8a4959813041a8868f908de87854c7 2023-02-08 00:58:47,038 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302087af147aaf6384b718ff16e0ed35554ca to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302087af147aaf6384b718ff16e0ed35554ca 2023-02-08 00:58:47,039 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:47,039 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:47,057 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:47,057 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:47,057 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:47,057 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:47,066 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/0c15e278073142f192b945f6ad0b626a first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-08 00:58:47,066 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/a6de8bbd923447d3adb7fc63fcf8c259 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-08 00:58:47,068 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/a6de8bbd923447d3adb7fc63fcf8c259}] 2023-02-08 00:58:47,068 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/0c15e278073142f192b945f6ad0b626a}] 2023-02-08 00:58:47,070 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/a6de8bbd923447d3adb7fc63fcf8c259 for inclusion in 84c1293d4c4595b4d6d33cad2b445d99/family1 2023-02-08 00:58:47,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/0c15e278073142f192b945f6ad0b626a for inclusion in 9338368da41aeb4a27fe667e7462918a/family1 2023-02-08 00:58:47,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-08 00:58:47,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-08 00:58:47,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-08 00:58:47,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-08 00:58:47,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 84c1293d4c4595b4d6d33cad2b445d99: 2023-02-08 00:58:47,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 9338368da41aeb4a27fe667e7462918a: 2023-02-08 00:58:47,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/0c15e278073142f192b945f6ad0b626a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__tvnuhf925obantvrnuqvocdifkumu300qb22v193v155dn4vkua9sj0ppjnqajor/family1/0c15e278073142f192b945f6ad0b626a 2023-02-08 00:58:47,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/a6de8bbd923447d3adb7fc63fcf8c259 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__246eki9k3e0bhmn1d8eol4ppmb24idjpjtqcimr05hq5hmm0tcdkplaejcisr9co/family1/a6de8bbd923447d3adb7fc63fcf8c259 2023-02-08 00:58:47,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__tvnuhf925obantvrnuqvocdifkumu300qb22v193v155dn4vkua9sj0ppjnqajor/family1/0c15e278073142f192b945f6ad0b626a as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a53a5dc2c1994168977c8083f5dfd966_SeqId_29_ 2023-02-08 00:58:47,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__246eki9k3e0bhmn1d8eol4ppmb24idjpjtqcimr05hq5hmm0tcdkplaejcisr9co/family1/a6de8bbd923447d3adb7fc63fcf8c259 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/e360ad4ccd8d4fdfaa0ead1dbca2e707_SeqId_29_ 2023-02-08 00:58:47,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__tvnuhf925obantvrnuqvocdifkumu300qb22v193v155dn4vkua9sj0ppjnqajor/family1/0c15e278073142f192b945f6ad0b626a into 9338368da41aeb4a27fe667e7462918a/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a53a5dc2c1994168977c8083f5dfd966_SeqId_29_ - updating store file list. 2023-02-08 00:58:47,077 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__246eki9k3e0bhmn1d8eol4ppmb24idjpjtqcimr05hq5hmm0tcdkplaejcisr9co/family1/a6de8bbd923447d3adb7fc63fcf8c259 into 84c1293d4c4595b4d6d33cad2b445d99/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/e360ad4ccd8d4fdfaa0ead1dbca2e707_SeqId_29_ - updating store file list. 2023-02-08 00:58:47,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a53a5dc2c1994168977c8083f5dfd966_SeqId_29_ into 9338368da41aeb4a27fe667e7462918a/family1 2023-02-08 00:58:47,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__tvnuhf925obantvrnuqvocdifkumu300qb22v193v155dn4vkua9sj0ppjnqajor/family1/0c15e278073142f192b945f6ad0b626a into 9338368da41aeb4a27fe667e7462918a/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a53a5dc2c1994168977c8083f5dfd966_SeqId_29_) 2023-02-08 00:58:47,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/e360ad4ccd8d4fdfaa0ead1dbca2e707_SeqId_29_ into 84c1293d4c4595b4d6d33cad2b445d99/family1 2023-02-08 00:58:47,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__246eki9k3e0bhmn1d8eol4ppmb24idjpjtqcimr05hq5hmm0tcdkplaejcisr9co/family1/a6de8bbd923447d3adb7fc63fcf8c259 into 84c1293d4c4595b4d6d33cad2b445d99/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/e360ad4ccd8d4fdfaa0ead1dbca2e707_SeqId_29_) 2023-02-08 00:58:47,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__tvnuhf925obantvrnuqvocdifkumu300qb22v193v155dn4vkua9sj0ppjnqajor/family1/0c15e278073142f192b945f6ad0b626a 2023-02-08 00:58:47,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__246eki9k3e0bhmn1d8eol4ppmb24idjpjtqcimr05hq5hmm0tcdkplaejcisr9co/family1/a6de8bbd923447d3adb7fc63fcf8c259 2023-02-08 00:58:47,082 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:47,082 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:47,082 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:47,082 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:47,084 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302080d56f61817aa499a8a6c700d5427677b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302080d56f61817aa499a8a6c700d5427677b 2023-02-08 00:58:47,084 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302081b8a3787433e4edb8acf766920c2cd58 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302081b8a3787433e4edb8acf766920c2cd58 2023-02-08 00:58:47,084 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208634b7040b5f847b5bc9c60cf18a2a8c3 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208634b7040b5f847b5bc9c60cf18a2a8c3 2023-02-08 00:58:47,084 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208bee32da1c78040568b8d603fc9195d12 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208bee32da1c78040568b8d603fc9195d12 2023-02-08 00:58:47,085 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208ab9f748451af4fc2955f7c9bad85c063 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208ab9f748451af4fc2955f7c9bad85c063 2023-02-08 00:58:47,085 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208dfc96d73a32c440d97f8194d2e8a1603 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208dfc96d73a32c440d97f8194d2e8a1603 2023-02-08 00:58:47,086 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208cfe0bba23e494aad8459db2f96458784 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20230208cfe0bba23e494aad8459db2f96458784 2023-02-08 00:58:47,086 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208fc9f29a8895f4095863045e0578d9bbc to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208fc9f29a8895f4095863045e0578d9bbc 2023-02-08 00:58:47,086 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-08 00:58:47,086 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-08 00:58:47,086 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208' 2023-02-08 00:58:47,086 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208' 2023-02-08 00:58:47,087 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 00:58:47,087 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 00:58:47,087 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:47,087 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 00:58:47,087 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208d96ef305ed9d45699780f2643a2c8e0c_del] 2023-02-08 00:58:47,087 DEBUG [Listener at localhost.localdomain/36213] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:47,089 DEBUG [Listener at localhost.localdomain/36213] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208d96ef305ed9d45699780f2643a2c8e0c_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208d96ef305ed9d45699780f2643a2c8e0c_del 2023-02-08 00:58:47,089 INFO [Listener at localhost.localdomain/36213] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-08 00:58:47,089 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208bb34695cb98d447ba4837c1ede1cdd6f_del] 2023-02-08 00:58:47,090 DEBUG [Listener at localhost.localdomain/36213] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:47,091 DEBUG [Listener at localhost.localdomain/36213] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208bb34695cb98d447ba4837c1ede1cdd6f_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20230208bb34695cb98d447ba4837c1ede1cdd6f_del 2023-02-08 00:58:47,091 INFO [Listener at localhost.localdomain/36213] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-08 00:58:47,091 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020827859d3148c645489d82a0b7cc98b41b_del] 2023-02-08 00:58:47,092 DEBUG [Listener at localhost.localdomain/36213] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:47,093 DEBUG [Listener at localhost.localdomain/36213] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020827859d3148c645489d82a0b7cc98b41b_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023020827859d3148c645489d82a0b7cc98b41b_del 2023-02-08 00:58:47,093 INFO [Listener at localhost.localdomain/36213] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-02-08 00:58:47,096 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:58:47,098 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:58:47,103 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:58:47,104 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:58:47,110 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:47,110 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:47,111 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-02-08 00:58:47,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$11(2405): Client=jenkins//136.243.104.168 disable testCompactionWithHFileLink 2023-02-08 00:58:47,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-02-08 00:58:47,113 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:47,113 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:47,114 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817927114"}]},"ts":"1675817927114"} 2023-02-08 00:58:47,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-08 00:58:47,115 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-02-08 00:58:47,135 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-02-08 00:58:47,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89a0ab87c56c5be47f5c7e5dcda828ee, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9338368da41aeb4a27fe667e7462918a, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=84c1293d4c4595b4d6d33cad2b445d99, UNASSIGN}] 2023-02-08 00:58:47,137 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89a0ab87c56c5be47f5c7e5dcda828ee, UNASSIGN 2023-02-08 00:58:47,138 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=84c1293d4c4595b4d6d33cad2b445d99, UNASSIGN 2023-02-08 00:58:47,138 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9338368da41aeb4a27fe667e7462918a, UNASSIGN 2023-02-08 00:58:47,138 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=89a0ab87c56c5be47f5c7e5dcda828ee, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:47,138 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=84c1293d4c4595b4d6d33cad2b445d99, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:47,138 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=9338368da41aeb4a27fe667e7462918a, regionState=CLOSING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:47,138 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817927138"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817927138"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817927138"}]},"ts":"1675817927138"} 2023-02-08 00:58:47,138 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675817927138"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817927138"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817927138"}]},"ts":"1675817927138"} 2023-02-08 00:58:47,138 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817927138"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817927138"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817927138"}]},"ts":"1675817927138"} 2023-02-08 00:58:47,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=92, ppid=89, state=RUNNABLE; CloseRegionProcedure 89a0ab87c56c5be47f5c7e5dcda828ee, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:47,140 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=90, state=RUNNABLE; CloseRegionProcedure 9338368da41aeb4a27fe667e7462918a, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:47,140 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure 84c1293d4c4595b4d6d33cad2b445d99, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:47,214 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:47,214 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:47,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-08 00:58:47,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:47,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 9338368da41aeb4a27fe667e7462918a, disabling compactions & flushes 2023-02-08 00:58:47,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:47,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:47,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. after waiting 0 ms 2023-02-08 00:58:47,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:47,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-08 00:58:47,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:47,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 9338368da41aeb4a27fe667e7462918a: Waiting for close lock at 1675817927292Running coprocessor pre-close hooks at 1675817927292Disabling compacts and flushes for region at 1675817927292Disabling writes for close at 1675817927293 (+1 ms)Writing region close event to WAL at 1675817927296 (+3 ms)Running coprocessor post-close hooks at 1675817927302 (+6 ms)Closed at 1675817927302 2023-02-08 00:58:47,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:47,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:47,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 89a0ab87c56c5be47f5c7e5dcda828ee, disabling compactions & flushes 2023-02-08 00:58:47,304 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:47,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:47,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. after waiting 0 ms 2023-02-08 00:58:47,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:47,304 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=9338368da41aeb4a27fe667e7462918a, regionState=CLOSED 2023-02-08 00:58:47,304 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675817927304"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817927304"}]},"ts":"1675817927304"} 2023-02-08 00:58:47,308 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=90 2023-02-08 00:58:47,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=90, state=SUCCESS; CloseRegionProcedure 9338368da41aeb4a27fe667e7462918a, server=jenkins-hbase12.apache.org,36907,1675817727419 in 167 msec 2023-02-08 00:58:47,309 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-08 00:58:47,310 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9338368da41aeb4a27fe667e7462918a, UNASSIGN in 173 msec 2023-02-08 00:58:47,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:47,311 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 89a0ab87c56c5be47f5c7e5dcda828ee: Waiting for close lock at 1675817927304Running coprocessor pre-close hooks at 1675817927304Disabling compacts and flushes for region at 1675817927304Disabling writes for close at 1675817927304Writing region close event to WAL at 1675817927306 (+2 ms)Running coprocessor post-close hooks at 1675817927310 (+4 ms)Closed at 1675817927311 (+1 ms) 2023-02-08 00:58:47,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:47,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(109): Close 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:47,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 84c1293d4c4595b4d6d33cad2b445d99, disabling compactions & flushes 2023-02-08 00:58:47,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:47,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:47,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. after waiting 0 ms 2023-02-08 00:58:47,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:47,312 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=89a0ab87c56c5be47f5c7e5dcda828ee, regionState=CLOSED 2023-02-08 00:58:47,313 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817927312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817927312"}]},"ts":"1675817927312"} 2023-02-08 00:58:47,317 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=92, resume processing ppid=89 2023-02-08 00:58:47,317 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=89, state=SUCCESS; CloseRegionProcedure 89a0ab87c56c5be47f5c7e5dcda828ee, server=jenkins-hbase12.apache.org,36907,1675817727419 in 176 msec 2023-02-08 00:58:47,318 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89a0ab87c56c5be47f5c7e5dcda828ee, UNASSIGN in 181 msec 2023-02-08 00:58:47,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-02-08 00:58:47,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:47,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 84c1293d4c4595b4d6d33cad2b445d99: Waiting for close lock at 1675817927312Running coprocessor pre-close hooks at 1675817927312Disabling compacts and flushes for region at 1675817927312Disabling writes for close at 1675817927312Writing region close event to WAL at 1675817927320 (+8 ms)Running coprocessor post-close hooks at 1675817927322 (+2 ms)Closed at 1675817927323 (+1 ms) 2023-02-08 00:58:47,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.UnassignRegionHandler(147): Closed 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:47,324 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=84c1293d4c4595b4d6d33cad2b445d99, regionState=CLOSED 2023-02-08 00:58:47,324 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817927324"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817927324"}]},"ts":"1675817927324"} 2023-02-08 00:58:47,327 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-02-08 00:58:47,327 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure 84c1293d4c4595b4d6d33cad2b445d99, server=jenkins-hbase12.apache.org,36907,1675817727419 in 185 msec 2023-02-08 00:58:47,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=88 2023-02-08 00:58:47,328 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=84c1293d4c4595b4d6d33cad2b445d99, UNASSIGN in 191 msec 2023-02-08 00:58:47,328 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817927328"}]},"ts":"1675817927328"} 2023-02-08 00:58:47,329 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-02-08 00:58:47,416 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:47,416 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:47,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-08 00:58:47,609 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-02-08 00:58:47,613 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 500 msec 2023-02-08 00:58:47,718 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:47,718 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:47,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=88 2023-02-08 00:58:47,719 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-02-08 00:58:47,720 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:47,720 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:47,730 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1675817912203-1675817927730 2023-02-08 00:58:47,730 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:47,730 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:47,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1580): Client=jenkins//136.243.104.168 snapshot request for:{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-08 00:58:47,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1675817927731 (current time:1675817927731). 2023-02-08 00:58:47,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-02-08 00:58:47,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] zookeeper.ReadOnlyZKClient(139): Connect 0x7530d3b2 to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:58:48,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@506b10a8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:58:48,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:58:48,039 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:56300, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:58:48,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7530d3b2 to 127.0.0.1:49726 2023-02-08 00:58:48,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:58:48,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-02-08 00:58:48,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(659): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-08 00:58:48,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-08 00:58:48,045 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-08 00:58:48,045 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1675818528045 2023-02-08 00:58:48,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(664): Started snapshot: { ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-08 00:58:48,045 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1675817912203-1675817927730 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-02-08 00:58:48,046 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-02-08 00:58:48,046 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-02-08 00:58:48,146 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 00:58:48,146 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:48,146 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:48,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 00:58:48,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 00:58:48,148 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-02-08 00:58:48,348 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 00:58:48,348 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:48,348 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:48,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 00:58:48,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 00:58:48,349 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-02-08 00:58:48,457 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-02-08 00:58:48,458 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-08 00:58:48,458 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-08 00:58:48,459 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-08 00:58:48,459 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-08 00:58:48,459 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-02-08 00:58:48,459 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-08 00:58:48,459 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-08 00:58:48,459 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-02-08 00:58:48,461 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/6786426ee6f24a7e955c0c3a59939284, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a53a5dc2c1994168977c8083f5dfd966_SeqId_29_] hfiles 2023-02-08 00:58:48,461 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/1027d5212c7242ab83e28e2acdaa3f14, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/e360ad4ccd8d4fdfaa0ead1dbca2e707_SeqId_29_] hfiles 2023-02-08 00:58:48,461 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/6786426ee6f24a7e955c0c3a59939284 2023-02-08 00:58:48,461 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a53a5dc2c1994168977c8083f5dfd966_SeqId_29_ 2023-02-08 00:58:48,461 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/1027d5212c7242ab83e28e2acdaa3f14 2023-02-08 00:58:48,461 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/e360ad4ccd8d4fdfaa0ead1dbca2e707_SeqId_29_ 2023-02-08 00:58:48,461 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/45dcc72eb55c467a9dccb6f53f0f4217, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/a7d3455ec17f4d319d979e1d1a80f918_SeqId_29_] hfiles 2023-02-08 00:58:48,461 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/45dcc72eb55c467a9dccb6f53f0f4217 2023-02-08 00:58:48,461 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/a7d3455ec17f4d319d979e1d1a80f918_SeqId_29_ 2023-02-08 00:58:48,462 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/0477dda8cba54a60b654071064fee73b] hfiles 2023-02-08 00:58:48,462 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/0477dda8cba54a60b654071064fee73b 2023-02-08 00:58:48,462 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/221dd4f5d0af419a9edb95596180b9a3] hfiles 2023-02-08 00:58:48,462 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/35cad19271554a0e95d7c71ac10ea121] hfiles 2023-02-08 00:58:48,462 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/221dd4f5d0af419a9edb95596180b9a3 2023-02-08 00:58:48,462 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/35cad19271554a0e95d7c71ac10ea121 2023-02-08 00:58:48,462 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302087af147aaf6384b718ff16e0ed35554ca, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302085a8a4959813041a8868f908de87854c7, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208fb67611c18ab4a40ba89fc409072cb7b] hfiles 2023-02-08 00:58:48,462 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302087af147aaf6384b718ff16e0ed35554ca 2023-02-08 00:58:48,462 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302085a8a4959813041a8868f908de87854c7 2023-02-08 00:58:48,463 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208fb67611c18ab4a40ba89fc409072cb7b 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020821528418aaf9477e92907e8ec449a337, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020833a33c13ac654a35ac6d3ca7e9a9edf1, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302086f4ce6fa80f94dd1b3fe89261efb03cd, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208a004bcccce0f46c5bc4ef5c54b932908_del, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208da3b254f526447a99aa081c8bd65b2df, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302080c3a9519deef45a294f9588e6bdc6f73, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302081e6a0735946344caacd20b5274d0f3af, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208517de1d54dd442e8bc8bd34da4d0c697, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208a5a2b190b2c84b328d97038f63fcf2cc, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208facf3bdc6fa641a68d4df900bcffadb4_del, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302083ea0c834f4ae49b4bb92308e8e5677b9, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208605e41e5cc6e4246a71bfdf916124d21, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302087ad84c17c2514de0bf1d1f6150d14c2a_del, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208bef91af772c44e37919c302ef0a67f9b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208c39437fd949e4f099ddea261ae0acbd0] hfiles 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020821528418aaf9477e92907e8ec449a337 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023020833a33c13ac654a35ac6d3ca7e9a9edf1 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202302086f4ce6fa80f94dd1b3fe89261efb03cd 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208a004bcccce0f46c5bc4ef5c54b932908_del 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208da3b254f526447a99aa081c8bd65b2df 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302080c3a9519deef45a294f9588e6bdc6f73 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202302081e6a0735946344caacd20b5274d0f3af 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208517de1d54dd442e8bc8bd34da4d0c697 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208a5a2b190b2c84b328d97038f63fcf2cc 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208facf3bdc6fa641a68d4df900bcffadb4_del 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302083ea0c834f4ae49b4bb92308e8e5677b9 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208605e41e5cc6e4246a71bfdf916124d21 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302087ad84c17c2514de0bf1d1f6150d14c2a_del 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208bef91af772c44e37919c302ef0a67f9b 2023-02-08 00:58:48,468 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20230208c39437fd949e4f099ddea261ae0acbd0 2023-02-08 00:58:48,649 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 00:58:48,650 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:48,650 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:48,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 00:58:48,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 00:58:48,653 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-02-08 00:58:48,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-02-08 00:58:48,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1675817912203-1675817927730 2023-02-08 00:58:48,877 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675817912203-1675817927730 2023-02-08 00:58:49,153 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 00:58:49,153 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:49,153 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:49,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 00:58:49,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(404): Snapshoting '{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-02-08 00:58:49,155 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-02-08 00:58:49,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675817912203-1675817927730 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.hbase-snapshot/hbase-failsafe-snaptb-1675817912203-1675817927730 2023-02-08 00:58:49,737 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1675817912203-1675817927730 of table testCompactionWithHFileLink completed 2023-02-08 00:58:49,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675817912203-1675817927730 2023-02-08 00:58:49,737 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1675817912203-1675817927730 2023-02-08 00:58:49,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase12:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1675817912203-1675817927730 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1675817928046Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1675817928457 (+411 ms)Consolidate snapshot: hbase-failsafe-snaptb-1675817912203-1675817927730 at 1675817928876 (+419 ms)Loading Region manifests for hbase-failsafe-snaptb-1675817912203-1675817927730 at 1675817928876Writing data manifest for hbase-failsafe-snaptb-1675817912203-1675817927730 at 1675817928883 (+7 ms)Verifying snapshot: hbase-failsafe-snaptb-1675817912203-1675817927730 at 1675817929294 (+411 ms)Snapshot hbase-failsafe-snaptb-1675817912203-1675817927730 of table testCompactionWithHFileLink completed at 1675817929737 (+443 ms) 2023-02-08 00:58:49,738 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-02-08 00:58:49,740 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.6960 sec 2023-02-08 00:58:50,155 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-02-08 00:58:50,156 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:50,156 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:50,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1209): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-02-08 00:58:50,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(401): Snapshot '{ ss=hbase-failsafe-snaptb-1675817912203-1675817927730 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-02-08 00:58:50,160 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:50,161 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:50,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1675817912203" table: "testCompactionWithHFileLink" creation_time: 1675817912216 type: FLUSH version: 2 ttl: 0 ) 2023-02-08 00:58:50,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(880): Restore snapshot=snaptb-1675817912203 as table=testCompactionWithHFileLink 2023-02-08 00:58:50,202 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:50,202 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:50,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-08 00:58:50,302 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:50,303 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:50,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-08 00:58:50,505 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:50,505 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:50,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-08 00:58:50,610 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-08 00:58:50,613 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-02-08 00:58:50,613 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-02-08 00:58:50,615 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(374): Starting restore snapshot={ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-02-08 00:58:50,625 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1675817912203" table: "testCompactionWithHFileLink" creation_time: 1675817912216 type: FLUSH version: 2 ttl: 0 2023-02-08 00:58:50,625 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink 2023-02-08 00:58:50,630 DEBUG [PEWorker-3] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-02-08 00:58:50,632 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302087af147aaf6384b718ff16e0ed35554ca to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302087af147aaf6384b718ff16e0ed35554ca 2023-02-08 00:58:50,634 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302085a8a4959813041a8868f908de87854c7 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302085a8a4959813041a8868f908de87854c7 2023-02-08 00:58:50,635 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208fb67611c18ab4a40ba89fc409072cb7b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20230208fb67611c18ab4a40ba89fc409072cb7b 2023-02-08 00:58:50,635 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202302081b8a3787433e4edb8acf766920c2cd58 of snapshot=snaptb-1675817912203 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 00:58:50,641 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230208bee32da1c78040568b8d603fc9195d12 of snapshot=snaptb-1675817912203 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 00:58:50,645 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230208dfc96d73a32c440d97f8194d2e8a1603 of snapshot=snaptb-1675817912203 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 00:58:50,648 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20230208fc9f29a8895f4095863045e0578d9bbc of snapshot=snaptb-1675817912203 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 00:58:50,650 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202302080d56f61817aa499a8a6c700d5427677b of snapshot=snaptb-1675817912203 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 00:58:50,652 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230208634b7040b5f847b5bc9c60cf18a2a8c3 of snapshot=snaptb-1675817912203 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 00:58:50,655 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230208ab9f748451af4fc2955f7c9bad85c063 of snapshot=snaptb-1675817912203 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 00:58:50,659 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20230208cfe0bba23e494aad8459db2f96458784 of snapshot=snaptb-1675817912203 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 00:58:50,662 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023020813f48f83788542e6a6b76968ab2feb40 of snapshot=snaptb-1675817912203 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 00:58:50,664 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302083115e47f274a4d269d511449ed28dd95 of snapshot=snaptb-1675817912203 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 00:58:50,667 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023020841cb9609b27c496f8a67407d4465db85 of snapshot=snaptb-1675817912203 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 00:58:50,670 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202302086b17a8d7ccd645b2b72c8b5050e3ac1c of snapshot=snaptb-1675817912203 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-02-08 00:58:50,675 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302087ad84c17c2514de0bf1d1f6150d14c2a_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202302087ad84c17c2514de0bf1d1f6150d14c2a_del 2023-02-08 00:58:50,677 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208facf3bdc6fa641a68d4df900bcffadb4_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20230208facf3bdc6fa641a68d4df900bcffadb4_del 2023-02-08 00:58:50,678 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208a004bcccce0f46c5bc4ef5c54b932908_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20230208a004bcccce0f46c5bc4ef5c54b932908_del 2023-02-08 00:58:50,678 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:50,678 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:50,678 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(223): region to restore: 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:50,682 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/e360ad4ccd8d4fdfaa0ead1dbca2e707_SeqId_29_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/e360ad4ccd8d4fdfaa0ead1dbca2e707_SeqId_29_ 2023-02-08 00:58:50,682 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a53a5dc2c1994168977c8083f5dfd966_SeqId_29_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/a53a5dc2c1994168977c8083f5dfd966_SeqId_29_ 2023-02-08 00:58:50,682 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/a7d3455ec17f4d319d979e1d1a80f918_SeqId_29_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/a7d3455ec17f4d319d979e1d1a80f918_SeqId_29_ 2023-02-08 00:58:50,683 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/6786426ee6f24a7e955c0c3a59939284 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/6786426ee6f24a7e955c0c3a59939284 2023-02-08 00:58:50,683 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 32ad3bac17fc4da182401fd0674b4161 of snapshot=snaptb-1675817912203 to region=9338368da41aeb4a27fe667e7462918a table=testCompactionWithHFileLink 2023-02-08 00:58:50,683 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/45dcc72eb55c467a9dccb6f53f0f4217 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/45dcc72eb55c467a9dccb6f53f0f4217 2023-02-08 00:58:50,683 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0b47b0d0ff374ba5a83918d6ec87722c of snapshot=snaptb-1675817912203 to region=89a0ab87c56c5be47f5c7e5dcda828ee table=testCompactionWithHFileLink 2023-02-08 00:58:50,683 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/1027d5212c7242ab83e28e2acdaa3f14 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/1027d5212c7242ab83e28e2acdaa3f14 2023-02-08 00:58:50,684 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 61f44948dce74812a54741846e65864f of snapshot=snaptb-1675817912203 to region=84c1293d4c4595b4d6d33cad2b445d99 table=testCompactionWithHFileLink 2023-02-08 00:58:50,690 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2711b734a9a54aeb873ac5781a17315b of snapshot=snaptb-1675817912203 to region=84c1293d4c4595b4d6d33cad2b445d99 table=testCompactionWithHFileLink 2023-02-08 00:58:50,690 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 914020f3714948679271bb1ac4014cbe of snapshot=snaptb-1675817912203 to region=9338368da41aeb4a27fe667e7462918a table=testCompactionWithHFileLink 2023-02-08 00:58:50,690 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 157d1d946a37498ba85c679a775a8e5f of snapshot=snaptb-1675817912203 to region=89a0ab87c56c5be47f5c7e5dcda828ee table=testCompactionWithHFileLink 2023-02-08 00:58:50,694 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a3ba9365b9d84749af18cbd50c81216b of snapshot=snaptb-1675817912203 to region=9338368da41aeb4a27fe667e7462918a table=testCompactionWithHFileLink 2023-02-08 00:58:50,694 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f28538b2d96b458c9e94d1487098428b of snapshot=snaptb-1675817912203 to region=89a0ab87c56c5be47f5c7e5dcda828ee table=testCompactionWithHFileLink 2023-02-08 00:58:50,694 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 181d16d9fb42455aa19a563ddb119b7a of snapshot=snaptb-1675817912203 to region=84c1293d4c4595b4d6d33cad2b445d99 table=testCompactionWithHFileLink 2023-02-08 00:58:50,696 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1d5c7a174bfa494e951b974776a92357 of snapshot=snaptb-1675817912203 to region=9338368da41aeb4a27fe667e7462918a table=testCompactionWithHFileLink 2023-02-08 00:58:50,696 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1f4294965d164c09a938a95bffd4793b of snapshot=snaptb-1675817912203 to region=89a0ab87c56c5be47f5c7e5dcda828ee table=testCompactionWithHFileLink 2023-02-08 00:58:50,696 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b9a0140a3e384a57b168c92e212fcd4a of snapshot=snaptb-1675817912203 to region=84c1293d4c4595b4d6d33cad2b445d99 table=testCompactionWithHFileLink 2023-02-08 00:58:50,706 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/35cad19271554a0e95d7c71ac10ea121 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/35cad19271554a0e95d7c71ac10ea121 2023-02-08 00:58:50,706 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7248a2815e884b62be416154b778eb7b of snapshot=snaptb-1675817912203 to region=89a0ab87c56c5be47f5c7e5dcda828ee table=testCompactionWithHFileLink 2023-02-08 00:58:50,707 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/0477dda8cba54a60b654071064fee73b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/0477dda8cba54a60b654071064fee73b 2023-02-08 00:58:50,707 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/221dd4f5d0af419a9edb95596180b9a3 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/221dd4f5d0af419a9edb95596180b9a3 2023-02-08 00:58:50,707 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fb369dd9a58b499abdc4074a96c392a8 of snapshot=snaptb-1675817912203 to region=9338368da41aeb4a27fe667e7462918a table=testCompactionWithHFileLink 2023-02-08 00:58:50,707 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 30ce6d15bc614f898acca9ea78c25ab0 of snapshot=snaptb-1675817912203 to region=84c1293d4c4595b4d6d33cad2b445d99 table=testCompactionWithHFileLink 2023-02-08 00:58:50,709 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 79201498d5624db5882d048fb42c97bf of snapshot=snaptb-1675817912203 to region=89a0ab87c56c5be47f5c7e5dcda828ee table=testCompactionWithHFileLink 2023-02-08 00:58:50,709 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 96f0852960e949968254a73c25713b7f of snapshot=snaptb-1675817912203 to region=9338368da41aeb4a27fe667e7462918a table=testCompactionWithHFileLink 2023-02-08 00:58:50,710 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f6708c31fcad404f87bd2d268f67f8a6 of snapshot=snaptb-1675817912203 to region=84c1293d4c4595b4d6d33cad2b445d99 table=testCompactionWithHFileLink 2023-02-08 00:58:50,715 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2e583228507e4466b431aef4d66e0550 of snapshot=snaptb-1675817912203 to region=9338368da41aeb4a27fe667e7462918a table=testCompactionWithHFileLink 2023-02-08 00:58:50,715 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 479cc4f066f0415ab19e454360983796 of snapshot=snaptb-1675817912203 to region=89a0ab87c56c5be47f5c7e5dcda828ee table=testCompactionWithHFileLink 2023-02-08 00:58:50,715 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d0cf991cf5174844bda74325b9f34dc8 of snapshot=snaptb-1675817912203 to region=84c1293d4c4595b4d6d33cad2b445d99 table=testCompactionWithHFileLink 2023-02-08 00:58:50,717 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f40a6c5592584a3984c2073283d7e5a3 of snapshot=snaptb-1675817912203 to region=9338368da41aeb4a27fe667e7462918a table=testCompactionWithHFileLink 2023-02-08 00:58:50,718 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c6e5fe5a78024d3d8cb80ebde02be1eb of snapshot=snaptb-1675817912203 to region=84c1293d4c4595b4d6d33cad2b445d99 table=testCompactionWithHFileLink 2023-02-08 00:58:50,718 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 60b77def44d14713bd081b36d6327d3d of snapshot=snaptb-1675817912203 to region=89a0ab87c56c5be47f5c7e5dcda828ee table=testCompactionWithHFileLink 2023-02-08 00:58:50,720 INFO [PEWorker-3] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1675817912203" table: "testCompactionWithHFileLink" creation_time: 1675817912216 type: FLUSH version: 2 ttl: 0 2023-02-08 00:58:50,721 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675817930721"}]},"ts":"9223372036854775807"} 2023-02-08 00:58:50,721 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675817930721"}]},"ts":"9223372036854775807"} 2023-02-08 00:58:50,721 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1675817930721"}]},"ts":"9223372036854775807"} 2023-02-08 00:58:50,723 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-02-08 00:58:50,723 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 84c1293d4c4595b4d6d33cad2b445d99, NAME => 'testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 89a0ab87c56c5be47f5c7e5dcda828ee, NAME => 'testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9338368da41aeb4a27fe667e7462918a, NAME => 'testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.', STARTKEY => '1', ENDKEY => '2'}] 2023-02-08 00:58:50,723 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817930722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817930722"}]},"ts":"1675817930722"} 2023-02-08 00:58:50,723 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817930722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817930722"}]},"ts":"1675817930722"} 2023-02-08 00:58:50,723 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675817930722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817930722"}]},"ts":"1675817930722"} 2023-02-08 00:58:50,724 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-08 00:58:50,724 INFO [PEWorker-3] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-02-08 00:58:50,724 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 84c1293d4c4595b4d6d33cad2b445d99, NAME => 'testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 89a0ab87c56c5be47f5c7e5dcda828ee, NAME => 'testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9338368da41aeb4a27fe667e7462918a, NAME => 'testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.', STARTKEY => '1', ENDKEY => '2'}] 2023-02-08 00:58:50,725 INFO [PEWorker-3] procedure.RestoreSnapshotProcedure(447): Restore snapshot={ ss=snaptb-1675817912203 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-02-08 00:58:50,726 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1675817912203" table: "testCompactionWithHFileLink" creation_time: 1675817912216 type: FLUSH version: 2 ttl: 0 ) in 532 msec 2023-02-08 00:58:50,807 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:50,807 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:50,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=96 2023-02-08 00:58:50,809 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-02-08 00:58:50,809 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1675817912203-1675817927730 2023-02-08 00:58:50,810 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:50,810 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:50,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(748): Client=jenkins//136.243.104.168 delete name: "hbase-failsafe-snaptb-1675817912203-1675817927730" 2023-02-08 00:58:50,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] snapshot.SnapshotManager(333): Deleting snapshot: hbase-failsafe-snaptb-1675817912203-1675817927730 2023-02-08 00:58:50,823 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:50,823 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:50,823 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-02-08 00:58:50,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.HMaster$10(2372): Client=jenkins//136.243.104.168 enable testCompactionWithHFileLink 2023-02-08 00:58:50,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-02-08 00:58:50,834 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:50,834 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-02-08 00:58:50,834 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:50,834 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817930834"}]},"ts":"1675817930834"} 2023-02-08 00:58:50,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-08 00:58:50,835 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-02-08 00:58:50,935 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:50,935 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:50,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-08 00:58:50,942 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-02-08 00:58:50,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89a0ab87c56c5be47f5c7e5dcda828ee, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9338368da41aeb4a27fe667e7462918a, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=84c1293d4c4595b4d6d33cad2b445d99, ASSIGN}] 2023-02-08 00:58:50,946 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=84c1293d4c4595b4d6d33cad2b445d99, ASSIGN 2023-02-08 00:58:50,947 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9338368da41aeb4a27fe667e7462918a, ASSIGN 2023-02-08 00:58:50,947 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89a0ab87c56c5be47f5c7e5dcda828ee, ASSIGN 2023-02-08 00:58:50,948 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=84c1293d4c4595b4d6d33cad2b445d99, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-08 00:58:50,948 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89a0ab87c56c5be47f5c7e5dcda828ee, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-08 00:58:50,948 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9338368da41aeb4a27fe667e7462918a, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-02-08 00:58:51,102 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=84c1293d4c4595b4d6d33cad2b445d99, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:51,102 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=9338368da41aeb4a27fe667e7462918a, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:51,102 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=89a0ab87c56c5be47f5c7e5dcda828ee, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:51,102 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675817931101"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817931101"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817931101"}]},"ts":"1675817931101"} 2023-02-08 00:58:51,102 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817931101"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817931101"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817931101"}]},"ts":"1675817931101"} 2023-02-08 00:58:51,103 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817931102"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817931102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817931102"}]},"ts":"1675817931102"} 2023-02-08 00:58:51,106 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=101, ppid=99, state=RUNNABLE; OpenRegionProcedure 9338368da41aeb4a27fe667e7462918a, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:51,107 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; OpenRegionProcedure 84c1293d4c4595b4d6d33cad2b445d99, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:51,108 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 89a0ab87c56c5be47f5c7e5dcda828ee, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:51,137 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:51,137 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:51,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-08 00:58:51,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:51,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 84c1293d4c4595b4d6d33cad2b445d99, NAME => 'testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.', STARTKEY => '2', ENDKEY => ''} 2023-02-08 00:58:51,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:51,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:51,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:51,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:51,266 INFO [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:51,268 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1 2023-02-08 00:58:51,268 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1 2023-02-08 00:58:51,269 INFO [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84c1293d4c4595b4d6d33cad2b445d99 columnFamilyName family1 2023-02-08 00:58:51,289 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-181d16d9fb42455aa19a563ddb119b7a 2023-02-08 00:58:51,297 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-2711b734a9a54aeb873ac5781a17315b 2023-02-08 00:58:51,304 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-61f44948dce74812a54741846e65864f 2023-02-08 00:58:51,309 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-b9a0140a3e384a57b168c92e212fcd4a 2023-02-08 00:58:51,309 INFO [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(310): Store=84c1293d4c4595b4d6d33cad2b445d99/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:51,310 INFO [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:51,310 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2 2023-02-08 00:58:51,311 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2 2023-02-08 00:58:51,311 INFO [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 84c1293d4c4595b4d6d33cad2b445d99 columnFamilyName family2 2023-02-08 00:58:51,318 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-30ce6d15bc614f898acca9ea78c25ab0 2023-02-08 00:58:51,323 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-c6e5fe5a78024d3d8cb80ebde02be1eb 2023-02-08 00:58:51,328 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-d0cf991cf5174844bda74325b9f34dc8 2023-02-08 00:58:51,333 DEBUG [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-f6708c31fcad404f87bd2d268f67f8a6 2023-02-08 00:58:51,333 INFO [StoreOpener-84c1293d4c4595b4d6d33cad2b445d99-1] regionserver.HStore(310): Store=84c1293d4c4595b4d6d33cad2b445d99/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:51,334 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:51,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:51,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:58:51,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 00:58:51,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 84c1293d4c4595b4d6d33cad2b445d99; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60432894, jitterRate=-0.09947970509529114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:58:51,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 84c1293d4c4595b4d6d33cad2b445d99: Running coprocessor pre-open hook at 1675817931264Writing region info on filesystem at 1675817931264Initializing all the Stores at 1675817931266 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817931266Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817931266Cleaning up temporary data from old regions at 1675817931335 (+69 ms)Cleaning up detritus from prior splits at 1675817931336 (+1 ms)Running coprocessor post-open hooks at 1675817931337 (+1 ms)Region opened successfully at 1675817931337 2023-02-08 00:58:51,338 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99., pid=102, masterSystemTime=1675817931258 2023-02-08 00:58:51,338 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:58:51,339 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-08 00:58:51,339 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-08 00:58:51,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-08 00:58:51,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:51,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:51,341 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:51,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 89a0ab87c56c5be47f5c7e5dcda828ee, NAME => 'testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.', STARTKEY => '', ENDKEY => '1'} 2023-02-08 00:58:51,341 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=84c1293d4c4595b4d6d33cad2b445d99, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:51,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:51,341 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817931341"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817931341"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817931341"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817931341"}]},"ts":"1675817931341"} 2023-02-08 00:58:51,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:51,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:51,341 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:51,341 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-08 00:58:51,342 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-08 00:58:51,342 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1912): 84c1293d4c4595b4d6d33cad2b445d99/family2 is initiating minor compaction (all files) 2023-02-08 00:58:51,342 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HStore(1912): 84c1293d4c4595b4d6d33cad2b445d99/family1 is initiating minor compaction (all files) 2023-02-08 00:58:51,342 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 84c1293d4c4595b4d6d33cad2b445d99/family2 in testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:51,342 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 84c1293d4c4595b4d6d33cad2b445d99/family1 in testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 00:58:51,342 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-30ce6d15bc614f898acca9ea78c25ab0, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-f6708c31fcad404f87bd2d268f67f8a6, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-d0cf991cf5174844bda74325b9f34dc8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-c6e5fe5a78024d3d8cb80ebde02be1eb] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp, totalSize=20.4 K 2023-02-08 00:58:51,342 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-61f44948dce74812a54741846e65864f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-2711b734a9a54aeb873ac5781a17315b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-181d16d9fb42455aa19a563ddb119b7a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-b9a0140a3e384a57b168c92e212fcd4a] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp, totalSize=21.6 K 2023-02-08 00:58:51,343 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-30ce6d15bc614f898acca9ea78c25ab0, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817901009 2023-02-08 00:58:51,343 INFO [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:51,343 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-61f44948dce74812a54741846e65864f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817901009 2023-02-08 00:58:51,343 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-f6708c31fcad404f87bd2d268f67f8a6, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817903799 2023-02-08 00:58:51,344 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-2711b734a9a54aeb873ac5781a17315b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817903799 2023-02-08 00:58:51,344 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-02-08 00:58:51,344 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; OpenRegionProcedure 84c1293d4c4595b4d6d33cad2b445d99, server=jenkins-hbase12.apache.org,36907,1675817727419 in 236 msec 2023-02-08 00:58:51,344 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-d0cf991cf5174844bda74325b9f34dc8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817906751 2023-02-08 00:58:51,344 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1 2023-02-08 00:58:51,345 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1 2023-02-08 00:58:51,345 INFO [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89a0ab87c56c5be47f5c7e5dcda828ee columnFamilyName family1 2023-02-08 00:58:51,345 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-181d16d9fb42455aa19a563ddb119b7a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817906751 2023-02-08 00:58:51,345 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-c6e5fe5a78024d3d8cb80ebde02be1eb, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817909443 2023-02-08 00:58:51,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=84c1293d4c4595b4d6d33cad2b445d99, ASSIGN in 401 msec 2023-02-08 00:58:51,347 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-b9a0140a3e384a57b168c92e212fcd4a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817909443 2023-02-08 00:58:51,362 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-0b47b0d0ff374ba5a83918d6ec87722c 2023-02-08 00:58:51,369 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-157d1d946a37498ba85c679a775a8e5f 2023-02-08 00:58:51,373 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 84c1293d4c4595b4d6d33cad2b445d99#family2#compaction#114 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 53.85 MB/second 2023-02-08 00:58:51,374 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] throttle.PressureAwareThroughputController(145): 84c1293d4c4595b4d6d33cad2b445d99#family1#compaction#115 average throughput is 1.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 00:58:51,377 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-1f4294965d164c09a938a95bffd4793b 2023-02-08 00:58:51,383 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-f28538b2d96b458c9e94d1487098428b 2023-02-08 00:58:51,386 INFO [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(310): Store=89a0ab87c56c5be47f5c7e5dcda828ee/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:51,386 INFO [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:51,387 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2 2023-02-08 00:58:51,387 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2 2023-02-08 00:58:51,387 INFO [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 89a0ab87c56c5be47f5c7e5dcda828ee columnFamilyName family2 2023-02-08 00:58:51,394 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-479cc4f066f0415ab19e454360983796 2023-02-08 00:58:51,398 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-60b77def44d14713bd081b36d6327d3d 2023-02-08 00:58:51,402 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-7248a2815e884b62be416154b778eb7b 2023-02-08 00:58:51,407 DEBUG [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-79201498d5624db5882d048fb42c97bf 2023-02-08 00:58:51,407 INFO [StoreOpener-89a0ab87c56c5be47f5c7e5dcda828ee-1] regionserver.HStore(310): Store=89a0ab87c56c5be47f5c7e5dcda828ee/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:51,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:51,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:51,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:58:51,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 00:58:51,413 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 89a0ab87c56c5be47f5c7e5dcda828ee; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64631328, jitterRate=-0.03691816329956055}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:58:51,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 89a0ab87c56c5be47f5c7e5dcda828ee: Running coprocessor pre-open hook at 1675817931341Writing region info on filesystem at 1675817931341Initializing all the Stores at 1675817931342 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817931342Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817931342Cleaning up temporary data from old regions at 1675817931410 (+68 ms)Cleaning up detritus from prior splits at 1675817931411 (+1 ms)Running coprocessor post-open hooks at 1675817931414 (+3 ms)Region opened successfully at 1675817931414 2023-02-08 00:58:51,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee., pid=103, masterSystemTime=1675817931258 2023-02-08 00:58:51,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-02-08 00:58:51,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-08 00:58:51,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:51,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:51,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:51,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 9338368da41aeb4a27fe667e7462918a, NAME => 'testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.', STARTKEY => '1', ENDKEY => '2'} 2023-02-08 00:58:51,415 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=89a0ab87c56c5be47f5c7e5dcda828ee, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:51,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:51,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:51,416 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1675817931415"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817931415"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817931415"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817931415"}]},"ts":"1675817931415"} 2023-02-08 00:58:51,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:51,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:51,417 INFO [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:51,417 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1 2023-02-08 00:58:51,417 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1 2023-02-08 00:58:51,418 INFO [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9338368da41aeb4a27fe667e7462918a columnFamilyName family1 2023-02-08 00:58:51,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=98 2023-02-08 00:58:51,418 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 89a0ab87c56c5be47f5c7e5dcda828ee, server=jenkins-hbase12.apache.org,36907,1675817727419 in 309 msec 2023-02-08 00:58:51,419 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=89a0ab87c56c5be47f5c7e5dcda828ee, ASSIGN in 475 msec 2023-02-08 00:58:51,424 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-1d5c7a174bfa494e951b974776a92357 2023-02-08 00:58:51,429 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-32ad3bac17fc4da182401fd0674b4161 2023-02-08 00:58:51,436 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-914020f3714948679271bb1ac4014cbe 2023-02-08 00:58:51,438 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:51,438 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:51,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-08 00:58:51,447 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-a3ba9365b9d84749af18cbd50c81216b 2023-02-08 00:58:51,447 INFO [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(310): Store=9338368da41aeb4a27fe667e7462918a/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:51,448 INFO [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:51,449 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2 2023-02-08 00:58:51,449 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2 2023-02-08 00:58:51,449 INFO [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9338368da41aeb4a27fe667e7462918a columnFamilyName family2 2023-02-08 00:58:51,459 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-2e583228507e4466b431aef4d66e0550 2023-02-08 00:58:51,469 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-96f0852960e949968254a73c25713b7f 2023-02-08 00:58:51,475 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-f40a6c5592584a3984c2073283d7e5a3 2023-02-08 00:58:51,481 DEBUG [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(539): loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-fb369dd9a58b499abdc4074a96c392a8 2023-02-08 00:58:51,482 INFO [StoreOpener-9338368da41aeb4a27fe667e7462918a-1] regionserver.HStore(310): Store=9338368da41aeb4a27fe667e7462918a/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:51,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:51,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:51,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:58:51,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 9338368da41aeb4a27fe667e7462918a 2023-02-08 00:58:51,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 9338368da41aeb4a27fe667e7462918a; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70603630, jitterRate=0.0520760715007782}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:58:51,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 9338368da41aeb4a27fe667e7462918a: Running coprocessor pre-open hook at 1675817931416Writing region info on filesystem at 1675817931416Initializing all the Stores at 1675817931416Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817931416Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817931417 (+1 ms)Cleaning up temporary data from old regions at 1675817931483 (+66 ms)Cleaning up detritus from prior splits at 1675817931484 (+1 ms)Running coprocessor post-open hooks at 1675817931486 (+2 ms)Region opened successfully at 1675817931486 2023-02-08 00:58:51,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a., pid=101, masterSystemTime=1675817931258 2023-02-08 00:58:51,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-08 00:58:51,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-08 00:58:51,487 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:51,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:51,488 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=9338368da41aeb4a27fe667e7462918a, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:51,488 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675817931488"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817931488"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817931488"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817931488"}]},"ts":"1675817931488"} 2023-02-08 00:58:51,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-02-08 00:58:51,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; OpenRegionProcedure 9338368da41aeb4a27fe667e7462918a, server=jenkins-hbase12.apache.org,36907,1675817727419 in 383 msec 2023-02-08 00:58:51,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=99, resume processing ppid=97 2023-02-08 00:58:51,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=9338368da41aeb4a27fe667e7462918a, ASSIGN in 547 msec 2023-02-08 00:58:51,492 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817931492"}]},"ts":"1675817931492"} 2023-02-08 00:58:51,492 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-02-08 00:58:51,676 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-02-08 00:58:51,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 850 msec 2023-02-08 00:58:51,940 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:51,940 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:51,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=97 2023-02-08 00:58:51,943 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-02-08 00:58:51,966 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:58:51,977 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:58:51,985 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:58:51,985 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:58:51,991 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-08 00:58:52,004 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-02-08 00:58:52,005 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:52,005 DEBUG [Listener at localhost.localdomain/36213] zookeeper.ReadOnlyZKClient(139): Connect 0x56bb74b2 to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:58:52,204 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family2/8efd0714936e47878844baf17d43ebbf as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/8efd0714936e47878844baf17d43ebbf 2023-02-08 00:58:52,210 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-02-08 00:58:52,210 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 84c1293d4c4595b4d6d33cad2b445d99/family2 of 84c1293d4c4595b4d6d33cad2b445d99 into 8efd0714936e47878844baf17d43ebbf(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:58:52,210 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 84c1293d4c4595b4d6d33cad2b445d99: 2023-02-08 00:58:52,210 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99., storeName=84c1293d4c4595b4d6d33cad2b445d99/family2, priority=12, startTime=1675817931339; duration=0sec 2023-02-08 00:58:52,211 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-02-08 00:58:52,211 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-08 00:58:52,215 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-08 00:58:52,215 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1912): 89a0ab87c56c5be47f5c7e5dcda828ee/family1 is initiating minor compaction (all files) 2023-02-08 00:58:52,215 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 89a0ab87c56c5be47f5c7e5dcda828ee/family1 in testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:52,215 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-0b47b0d0ff374ba5a83918d6ec87722c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-157d1d946a37498ba85c679a775a8e5f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-f28538b2d96b458c9e94d1487098428b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-1f4294965d164c09a938a95bffd4793b] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp, totalSize=21.6 K 2023-02-08 00:58:52,216 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-0b47b0d0ff374ba5a83918d6ec87722c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817901007 2023-02-08 00:58:52,217 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-157d1d946a37498ba85c679a775a8e5f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817903799 2023-02-08 00:58:52,218 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-f28538b2d96b458c9e94d1487098428b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817906750 2023-02-08 00:58:52,219 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-1f4294965d164c09a938a95bffd4793b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817909442 2023-02-08 00:58:52,234 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 89a0ab87c56c5be47f5c7e5dcda828ee#family1#compaction#116 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 00:58:52,257 DEBUG [Listener at localhost.localdomain/36213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7025662b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:58:52,257 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 00:58:52,257 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 00:58:52,257 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 00:58:52,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-30ce6d15bc614f898acca9ea78c25ab0, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-f6708c31fcad404f87bd2d268f67f8a6, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-d0cf991cf5174844bda74325b9f34dc8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-c6e5fe5a78024d3d8cb80ebde02be1eb] to archive 2023-02-08 00:58:52,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:52,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-30ce6d15bc614f898acca9ea78c25ab0 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-30ce6d15bc614f898acca9ea78c25ab0 2023-02-08 00:58:52,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-f6708c31fcad404f87bd2d268f67f8a6 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-f6708c31fcad404f87bd2d268f67f8a6 2023-02-08 00:58:52,314 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-d0cf991cf5174844bda74325b9f34dc8 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-d0cf991cf5174844bda74325b9f34dc8 2023-02-08 00:58:52,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-c6e5fe5a78024d3d8cb80ebde02be1eb to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family2/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-c6e5fe5a78024d3d8cb80ebde02be1eb 2023-02-08 00:58:52,608 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/.tmp/family1/462654a33afd425c9c4dba2a61f89b8d as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/462654a33afd425c9c4dba2a61f89b8d 2023-02-08 00:58:52,617 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 84c1293d4c4595b4d6d33cad2b445d99/family1 of 84c1293d4c4595b4d6d33cad2b445d99 into 462654a33afd425c9c4dba2a61f89b8d(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:58:52,617 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 84c1293d4c4595b4d6d33cad2b445d99: 2023-02-08 00:58:52,618 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99., storeName=84c1293d4c4595b4d6d33cad2b445d99/family1, priority=12, startTime=1675817931338; duration=1sec 2023-02-08 00:58:52,618 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-08 00:58:52,619 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-08 00:58:52,622 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-08 00:58:52,622 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HStore(1912): 9338368da41aeb4a27fe667e7462918a/family2 is initiating minor compaction (all files) 2023-02-08 00:58:52,622 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 9338368da41aeb4a27fe667e7462918a/family2 in testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:52,622 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-fb369dd9a58b499abdc4074a96c392a8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-96f0852960e949968254a73c25713b7f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-2e583228507e4466b431aef4d66e0550, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-f40a6c5592584a3984c2073283d7e5a3] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp, totalSize=20.4 K 2023-02-08 00:58:52,623 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-fb369dd9a58b499abdc4074a96c392a8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817901008 2023-02-08 00:58:52,623 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-96f0852960e949968254a73c25713b7f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817903799 2023-02-08 00:58:52,624 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-2e583228507e4466b431aef4d66e0550, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817906750 2023-02-08 00:58:52,624 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-f40a6c5592584a3984c2073283d7e5a3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817909443 2023-02-08 00:58:52,639 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] throttle.PressureAwareThroughputController(145): 9338368da41aeb4a27fe667e7462918a#family2#compaction#117 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 00:58:52,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-61f44948dce74812a54741846e65864f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-2711b734a9a54aeb873ac5781a17315b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-181d16d9fb42455aa19a563ddb119b7a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-b9a0140a3e384a57b168c92e212fcd4a] to archive 2023-02-08 00:58:52,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:52,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-61f44948dce74812a54741846e65864f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-61f44948dce74812a54741846e65864f 2023-02-08 00:58:52,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-2711b734a9a54aeb873ac5781a17315b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-2711b734a9a54aeb873ac5781a17315b 2023-02-08 00:58:52,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-181d16d9fb42455aa19a563ddb119b7a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-181d16d9fb42455aa19a563ddb119b7a 2023-02-08 00:58:52,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-b9a0140a3e384a57b168c92e212fcd4a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/testCompactionWithHFileLink=84c1293d4c4595b4d6d33cad2b445d99-b9a0140a3e384a57b168c92e212fcd4a 2023-02-08 00:58:52,735 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020833965b8ed28c4fbcb723859eab6f4801 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023020833965b8ed28c4fbcb723859eab6f4801 2023-02-08 00:58:52,736 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:52,748 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:58:52,751 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:56302, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:58:52,758 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:52,758 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:52,758 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:58:52,762 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:50816, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:58:52,771 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/e7fbe3510bef49adacb53f551587a075 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-02-08 00:58:52,772 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=32 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/e7fbe3510bef49adacb53f551587a075}] 2023-02-08 00:58:52,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/e7fbe3510bef49adacb53f551587a075 for inclusion in 89a0ab87c56c5be47f5c7e5dcda828ee/family1 2023-02-08 00:58:52,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-02-08 00:58:52,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last=1 2023-02-08 00:58:52,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 89a0ab87c56c5be47f5c7e5dcda828ee: 2023-02-08 00:58:52,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208/family1/e7fbe3510bef49adacb53f551587a075 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__dmku53hb473u1p1gto14ul2sm7bm7tsikbvo5k4r80lbj1pusbudqk7ludug86tr/family1/e7fbe3510bef49adacb53f551587a075 2023-02-08 00:58:52,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__dmku53hb473u1p1gto14ul2sm7bm7tsikbvo5k4r80lbj1pusbudqk7ludug86tr/family1/e7fbe3510bef49adacb53f551587a075 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/b4417c97d2944d3aa3504346bbd139a7_SeqId_34_ 2023-02-08 00:58:52,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__dmku53hb473u1p1gto14ul2sm7bm7tsikbvo5k4r80lbj1pusbudqk7ludug86tr/family1/e7fbe3510bef49adacb53f551587a075 into 89a0ab87c56c5be47f5c7e5dcda828ee/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/b4417c97d2944d3aa3504346bbd139a7_SeqId_34_ - updating store file list. 2023-02-08 00:58:52,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/b4417c97d2944d3aa3504346bbd139a7_SeqId_34_ into 89a0ab87c56c5be47f5c7e5dcda828ee/family1 2023-02-08 00:58:52,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__dmku53hb473u1p1gto14ul2sm7bm7tsikbvo5k4r80lbj1pusbudqk7ludug86tr/family1/e7fbe3510bef49adacb53f551587a075 into 89a0ab87c56c5be47f5c7e5dcda828ee/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/b4417c97d2944d3aa3504346bbd139a7_SeqId_34_) 2023-02-08 00:58:52,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__dmku53hb473u1p1gto14ul2sm7bm7tsikbvo5k4r80lbj1pusbudqk7ludug86tr/family1/e7fbe3510bef49adacb53f551587a075 2023-02-08 00:58:52,788 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:52,789 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:52,790 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023020813f48f83788542e6a6b76968ab2feb40 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023020813f48f83788542e6a6b76968ab2feb40 2023-02-08 00:58:52,791 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302083115e47f274a4d269d511449ed28dd95 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302083115e47f274a4d269d511449ed28dd95 2023-02-08 00:58:52,792 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023020841cb9609b27c496f8a67407d4465db85 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023020841cb9609b27c496f8a67407d4465db85 2023-02-08 00:58:52,793 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302086b17a8d7ccd645b2b72c8b5050e3ac1c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202302086b17a8d7ccd645b2b72c8b5050e3ac1c 2023-02-08 00:58:52,793 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-08 00:58:52,793 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20230208' 2023-02-08 00:58:52,793 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 00:58:52,837 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:58:53,135 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302080d3ca47cd83e4273816ac1b9d7c9a7d6 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202302080d3ca47cd83e4273816ac1b9d7c9a7d6 2023-02-08 00:58:53,135 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302081bec0815b7084e2f963e7f9a0ea706ac to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202302081bec0815b7084e2f963e7f9a0ea706ac 2023-02-08 00:58:53,136 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:53,136 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:53,157 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:53,157 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:53,157 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:53,157 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:53,170 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/ce3d9b518a614cab8d57065a2a626bae first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-02-08 00:58:53,171 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/ce3d9b518a614cab8d57065a2a626bae}] 2023-02-08 00:58:53,171 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/c38d7b99bdeb4a50a1e811d687fe1c5c first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-02-08 00:58:53,172 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/c38d7b99bdeb4a50a1e811d687fe1c5c}] 2023-02-08 00:58:53,174 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/ce3d9b518a614cab8d57065a2a626bae for inclusion in 9338368da41aeb4a27fe667e7462918a/family1 2023-02-08 00:58:53,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/c38d7b99bdeb4a50a1e811d687fe1c5c for inclusion in 84c1293d4c4595b4d6d33cad2b445d99/family1 2023-02-08 00:58:53,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-02-08 00:58:53,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-08 00:58:53,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-02-08 00:58:53,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-08 00:58:53,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 84c1293d4c4595b4d6d33cad2b445d99: 2023-02-08 00:58:53,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 9338368da41aeb4a27fe667e7462918a: 2023-02-08 00:58:53,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208/family1/c38d7b99bdeb4a50a1e811d687fe1c5c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__lojrdit42co5i0uj0ivsk9mbpu5gnfushhvs08do7esnuvb72ogunbqj20r73cus/family1/c38d7b99bdeb4a50a1e811d687fe1c5c 2023-02-08 00:58:53,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208/family1/ce3d9b518a614cab8d57065a2a626bae to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__u0fp8cr156b3biq080nle27ai3v2l6htk5jsrt760u5p9262rfne6iooi5bpmqr8/family1/ce3d9b518a614cab8d57065a2a626bae 2023-02-08 00:58:53,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__lojrdit42co5i0uj0ivsk9mbpu5gnfushhvs08do7esnuvb72ogunbqj20r73cus/family1/c38d7b99bdeb4a50a1e811d687fe1c5c as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/8cc50181acd64aea96a985618dd3df02_SeqId_36_ 2023-02-08 00:58:53,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__u0fp8cr156b3biq080nle27ai3v2l6htk5jsrt760u5p9262rfne6iooi5bpmqr8/family1/ce3d9b518a614cab8d57065a2a626bae as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/25b2a71943fa41ddaae37e3f1ef89fa4_SeqId_34_ 2023-02-08 00:58:53,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__lojrdit42co5i0uj0ivsk9mbpu5gnfushhvs08do7esnuvb72ogunbqj20r73cus/family1/c38d7b99bdeb4a50a1e811d687fe1c5c into 84c1293d4c4595b4d6d33cad2b445d99/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/8cc50181acd64aea96a985618dd3df02_SeqId_36_ - updating store file list. 2023-02-08 00:58:53,179 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__u0fp8cr156b3biq080nle27ai3v2l6htk5jsrt760u5p9262rfne6iooi5bpmqr8/family1/ce3d9b518a614cab8d57065a2a626bae into 9338368da41aeb4a27fe667e7462918a/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/25b2a71943fa41ddaae37e3f1ef89fa4_SeqId_34_ - updating store file list. 2023-02-08 00:58:53,182 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/25b2a71943fa41ddaae37e3f1ef89fa4_SeqId_34_ into 9338368da41aeb4a27fe667e7462918a/family1 2023-02-08 00:58:53,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/8cc50181acd64aea96a985618dd3df02_SeqId_36_ into 84c1293d4c4595b4d6d33cad2b445d99/family1 2023-02-08 00:58:53,182 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__u0fp8cr156b3biq080nle27ai3v2l6htk5jsrt760u5p9262rfne6iooi5bpmqr8/family1/ce3d9b518a614cab8d57065a2a626bae into 9338368da41aeb4a27fe667e7462918a/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/25b2a71943fa41ddaae37e3f1ef89fa4_SeqId_34_) 2023-02-08 00:58:53,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__lojrdit42co5i0uj0ivsk9mbpu5gnfushhvs08do7esnuvb72ogunbqj20r73cus/family1/c38d7b99bdeb4a50a1e811d687fe1c5c into 84c1293d4c4595b4d6d33cad2b445d99/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/family1/8cc50181acd64aea96a985618dd3df02_SeqId_36_) 2023-02-08 00:58:53,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__u0fp8cr156b3biq080nle27ai3v2l6htk5jsrt760u5p9262rfne6iooi5bpmqr8/family1/ce3d9b518a614cab8d57065a2a626bae 2023-02-08 00:58:53,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testCompactionWithHFileLink__lojrdit42co5i0uj0ivsk9mbpu5gnfushhvs08do7esnuvb72ogunbqj20r73cus/family1/c38d7b99bdeb4a50a1e811d687fe1c5c 2023-02-08 00:58:53,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:58:53,184 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:53,184 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:53,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-02-08 00:58:53,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(1912): 9338368da41aeb4a27fe667e7462918a/family1 is initiating minor compaction (all files) 2023-02-08 00:58:53,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1f5ef476; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-08 00:58:53,185 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302080d56f61817aa499a8a6c700d5427677b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202302080d56f61817aa499a8a6c700d5427677b 2023-02-08 00:58:53,186 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230208634b7040b5f847b5bc9c60cf18a2a8c3 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230208634b7040b5f847b5bc9c60cf18a2a8c3 2023-02-08 00:58:53,186 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:53,187 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:53,187 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230208ab9f748451af4fc2955f7c9bad85c063 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230208ab9f748451af4fc2955f7c9bad85c063 2023-02-08 00:58:53,188 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302081b8a3787433e4edb8acf766920c2cd58 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202302081b8a3787433e4edb8acf766920c2cd58 2023-02-08 00:58:53,188 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230208cfe0bba23e494aad8459db2f96458784 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20230208cfe0bba23e494aad8459db2f96458784 2023-02-08 00:58:53,188 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-08 00:58:53,188 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20230208' 2023-02-08 00:58:53,188 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 00:58:53,188 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230208bee32da1c78040568b8d603fc9195d12 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230208bee32da1c78040568b8d603fc9195d12 2023-02-08 00:58:53,189 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230208dfc96d73a32c440d97f8194d2e8a1603 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230208dfc96d73a32c440d97f8194d2e8a1603 2023-02-08 00:58:53,190 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230208fc9f29a8895f4095863045e0578d9bbc to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20230208fc9f29a8895f4095863045e0578d9bbc 2023-02-08 00:58:53,190 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-02-08 00:58:53,190 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20230208' 2023-02-08 00:58:53,190 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230208 for table='testCompactionWithHFileLink' and column='family1' 2023-02-08 00:58:53,190 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-02-08 00:58:53,192 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:58:53,194 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:58:53,199 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:58:53,200 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:58:53,206 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:58:53,207 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:58:53,222 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=276 (was 239) - Thread LEAK? -, OpenFileDescriptor=725 (was 599) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=311 (was 330), ProcessCount=175 (was 177), AvailableMemoryMB=3247 (was 3667) 2023-02-08 00:58:53,237 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=276, OpenFileDescriptor=725, MaxFileDescriptor=60000, SystemLoadAverage=311, ProcessCount=175, AvailableMemoryMB=3246 2023-02-08 00:58:53,239 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:53,239 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:53,244 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.HMaster$15(2997): Client=jenkins//136.243.104.168 creating {NAME => 'ns'} 2023-02-08 00:58:53,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-02-08 00:58:53,251 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:53,251 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:53,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-08 00:58:53,345 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-02-08 00:58:53,352 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:53,352 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:53,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-08 00:58:53,357 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 111 msec 2023-02-08 00:58:53,462 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family1/bc118907947a4ecfa19cef7b52eb5778 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/bc118907947a4ecfa19cef7b52eb5778 2023-02-08 00:58:53,468 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 89a0ab87c56c5be47f5c7e5dcda828ee/family1 of 89a0ab87c56c5be47f5c7e5dcda828ee into bc118907947a4ecfa19cef7b52eb5778(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:58:53,468 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 89a0ab87c56c5be47f5c7e5dcda828ee: 2023-02-08 00:58:53,468 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee., storeName=89a0ab87c56c5be47f5c7e5dcda828ee/family1, priority=12, startTime=1675817931414; duration=1sec 2023-02-08 00:58:53,469 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-02-08 00:58:53,469 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of 9338368da41aeb4a27fe667e7462918a/family1 in testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 00:58:53,469 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-32ad3bac17fc4da182401fd0674b4161, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-914020f3714948679271bb1ac4014cbe, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-a3ba9365b9d84749af18cbd50c81216b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-1d5c7a174bfa494e951b974776a92357, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/25b2a71943fa41ddaae37e3f1ef89fa4_SeqId_34_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp, totalSize=28.9 K 2023-02-08 00:58:53,470 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-32ad3bac17fc4da182401fd0674b4161, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817901008 2023-02-08 00:58:53,471 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-914020f3714948679271bb1ac4014cbe, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817903799 2023-02-08 00:58:53,471 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-a3ba9365b9d84749af18cbd50c81216b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817906750 2023-02-08 00:58:53,472 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-1d5c7a174bfa494e951b974776a92357, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817909443 2023-02-08 00:58:53,473 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 25b2a71943fa41ddaae37e3f1ef89fa4_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1675817901008 2023-02-08 00:58:53,489 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): 9338368da41aeb4a27fe667e7462918a#family1#compaction#118 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 00:58:53,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-0b47b0d0ff374ba5a83918d6ec87722c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-157d1d946a37498ba85c679a775a8e5f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-f28538b2d96b458c9e94d1487098428b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-1f4294965d164c09a938a95bffd4793b] to archive 2023-02-08 00:58:53,498 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:53,500 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-0b47b0d0ff374ba5a83918d6ec87722c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-0b47b0d0ff374ba5a83918d6ec87722c 2023-02-08 00:58:53,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-157d1d946a37498ba85c679a775a8e5f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-157d1d946a37498ba85c679a775a8e5f 2023-02-08 00:58:53,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-f28538b2d96b458c9e94d1487098428b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-f28538b2d96b458c9e94d1487098428b 2023-02-08 00:58:53,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-1f4294965d164c09a938a95bffd4793b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family1/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-1f4294965d164c09a938a95bffd4793b 2023-02-08 00:58:53,553 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:53,553 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:53,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=104 2023-02-08 00:58:53,556 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:53,556 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:53,559 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-08 00:58:53,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-02-08 00:58:53,562 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 00:58:53,562 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-02-08 00:58:53,563 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:53,563 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:53,563 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 00:58:53,564 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-08 00:58:53,566 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424 2023-02-08 00:58:53,566 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9 2023-02-08 00:58:53,566 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5 2023-02-08 00:58:53,567 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424 empty. 2023-02-08 00:58:53,567 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9 empty. 2023-02-08 00:58:53,567 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5 empty. 2023-02-08 00:58:53,567 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424 2023-02-08 00:58:53,567 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9 2023-02-08 00:58:53,567 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5 2023-02-08 00:58:53,567 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-02-08 00:58:53,664 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:53,665 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:53,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-08 00:58:53,866 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family2/77ee30e8d6024ef9bc5152bf1c9191e3 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/77ee30e8d6024ef9bc5152bf1c9191e3 2023-02-08 00:58:53,868 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:53,868 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:53,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-08 00:58:53,871 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 9338368da41aeb4a27fe667e7462918a/family2 of 9338368da41aeb4a27fe667e7462918a into 77ee30e8d6024ef9bc5152bf1c9191e3(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:58:53,871 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 9338368da41aeb4a27fe667e7462918a: 2023-02-08 00:58:53,871 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a., storeName=9338368da41aeb4a27fe667e7462918a/family2, priority=12, startTime=1675817931486; duration=1sec 2023-02-08 00:58:53,871 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-02-08 00:58:53,871 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 5 compacting, 0 eligible, 16 blocking 2023-02-08 00:58:53,871 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-02-08 00:58:53,871 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-02-08 00:58:53,871 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. because compaction request was cancelled 2023-02-08 00:58:53,871 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-02-08 00:58:53,873 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-02-08 00:58:53,873 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HStore(1912): 89a0ab87c56c5be47f5c7e5dcda828ee/family2 is initiating minor compaction (all files) 2023-02-08 00:58:53,873 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HRegion(2258): Starting compaction of 89a0ab87c56c5be47f5c7e5dcda828ee/family2 in testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 00:58:53,873 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-7248a2815e884b62be416154b778eb7b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-79201498d5624db5882d048fb42c97bf, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-479cc4f066f0415ab19e454360983796, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-60b77def44d14713bd081b36d6327d3d] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp, totalSize=20.4 K 2023-02-08 00:58:53,874 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-7248a2815e884b62be416154b778eb7b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817901007 2023-02-08 00:58:53,874 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-79201498d5624db5882d048fb42c97bf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817903799 2023-02-08 00:58:53,875 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-479cc4f066f0415ab19e454360983796, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817906750 2023-02-08 00:58:53,875 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-60b77def44d14713bd081b36d6327d3d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817909442 2023-02-08 00:58:53,897 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] throttle.PressureAwareThroughputController(145): 89a0ab87c56c5be47f5c7e5dcda828ee#family2#compaction#119 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-02-08 00:58:53,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-fb369dd9a58b499abdc4074a96c392a8, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-96f0852960e949968254a73c25713b7f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-2e583228507e4466b431aef4d66e0550, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-f40a6c5592584a3984c2073283d7e5a3] to archive 2023-02-08 00:58:53,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:53,922 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-fb369dd9a58b499abdc4074a96c392a8 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-fb369dd9a58b499abdc4074a96c392a8 2023-02-08 00:58:53,924 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-96f0852960e949968254a73c25713b7f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-96f0852960e949968254a73c25713b7f 2023-02-08 00:58:53,925 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-2e583228507e4466b431aef4d66e0550 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-2e583228507e4466b431aef4d66e0550 2023-02-08 00:58:53,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-f40a6c5592584a3984c2073283d7e5a3 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family2/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-f40a6c5592584a3984c2073283d7e5a3 2023-02-08 00:58:53,977 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-02-08 00:58:53,978 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7671): creating {ENCODED => a9b1b2d3dd6bede138606a2ea05db424, NAME => 'ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:58:53,979 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7671): creating {ENCODED => 2ac42b7db01e98b42cdc33a9b82921f5, NAME => 'ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:58:53,979 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7671): creating {ENCODED => 27ddb7f5c95f0b9f97df2803a621f3c9, NAME => 'ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:58:53,993 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:53,993 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1603): Closing 2ac42b7db01e98b42cdc33a9b82921f5, disabling compactions & flushes 2023-02-08 00:58:53,993 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:58:53,993 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:58:53,993 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. after waiting 0 ms 2023-02-08 00:58:53,993 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:58:53,993 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:58:53,994 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1557): Region close journal for 2ac42b7db01e98b42cdc33a9b82921f5: Waiting for close lock at 1675817933993Disabling compacts and flushes for region at 1675817933993Disabling writes for close at 1675817933993Writing region close event to WAL at 1675817933993Closed at 1675817933993 2023-02-08 00:58:54,169 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:54,169 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:54,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-08 00:58:54,387 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:54,387 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1603): Closing a9b1b2d3dd6bede138606a2ea05db424, disabling compactions & flushes 2023-02-08 00:58:54,387 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:58:54,387 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:58:54,387 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. after waiting 0 ms 2023-02-08 00:58:54,387 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:58:54,387 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:58:54,388 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1557): Region close journal for a9b1b2d3dd6bede138606a2ea05db424: Waiting for close lock at 1675817934387Disabling compacts and flushes for region at 1675817934387Disabling writes for close at 1675817934387Writing region close event to WAL at 1675817934387Closed at 1675817934387 2023-02-08 00:58:54,391 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:54,391 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1603): Closing 27ddb7f5c95f0b9f97df2803a621f3c9, disabling compactions & flushes 2023-02-08 00:58:54,391 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:58:54,392 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:58:54,392 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. after waiting 0 ms 2023-02-08 00:58:54,392 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:58:54,392 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:58:54,392 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1557): Region close journal for 27ddb7f5c95f0b9f97df2803a621f3c9: Waiting for close lock at 1675817934391Disabling compacts and flushes for region at 1675817934391Disabling writes for close at 1675817934392 (+1 ms)Writing region close event to WAL at 1675817934392Closed at 1675817934392 2023-02-08 00:58:54,396 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 00:58:54,398 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675817934398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817934398"}]},"ts":"1675817934398"} 2023-02-08 00:58:54,398 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675817934398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817934398"}]},"ts":"1675817934398"} 2023-02-08 00:58:54,398 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675817934398"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817934398"}]},"ts":"1675817934398"} 2023-02-08 00:58:54,400 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-08 00:58:54,401 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 00:58:54,401 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817934401"}]},"ts":"1675817934401"} 2023-02-08 00:58:54,403 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-02-08 00:58:54,670 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a9b1b2d3dd6bede138606a2ea05db424, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=27ddb7f5c95f0b9f97df2803a621f3c9, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2ac42b7db01e98b42cdc33a9b82921f5, ASSIGN}] 2023-02-08 00:58:54,670 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:54,671 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:54,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-08 00:58:54,674 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=27ddb7f5c95f0b9f97df2803a621f3c9, ASSIGN 2023-02-08 00:58:54,674 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a9b1b2d3dd6bede138606a2ea05db424, ASSIGN 2023-02-08 00:58:54,675 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2ac42b7db01e98b42cdc33a9b82921f5, ASSIGN 2023-02-08 00:58:54,676 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a9b1b2d3dd6bede138606a2ea05db424, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:58:54,676 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2ac42b7db01e98b42cdc33a9b82921f5, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:58:54,677 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=27ddb7f5c95f0b9f97df2803a621f3c9, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:58:54,742 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/.tmp/family1/ae42ebfe37554c86891e8b8d66ebfc09 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/ae42ebfe37554c86891e8b8d66ebfc09 2023-02-08 00:58:54,746 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/.tmp/family2/3532873c81d84680ba0402230f89038b as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/3532873c81d84680ba0402230f89038b 2023-02-08 00:58:54,747 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 9338368da41aeb4a27fe667e7462918a/family1 of 9338368da41aeb4a27fe667e7462918a into ae42ebfe37554c86891e8b8d66ebfc09(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:58:54,747 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for 9338368da41aeb4a27fe667e7462918a: 2023-02-08 00:58:54,747 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1675817933185; duration=1sec 2023-02-08 00:58:54,747 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:58:54,750 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 89a0ab87c56c5be47f5c7e5dcda828ee/family2 of 89a0ab87c56c5be47f5c7e5dcda828ee into 3532873c81d84680ba0402230f89038b(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:58:54,750 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.HRegion(2288): Compaction status journal for 89a0ab87c56c5be47f5c7e5dcda828ee: 2023-02-08 00:58:54,750 INFO [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee., storeName=89a0ab87c56c5be47f5c7e5dcda828ee/family2, priority=12, startTime=1675817931414; duration=0sec 2023-02-08 00:58:54,750 DEBUG [RS:0;jenkins-hbase12:36907-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:58:54,803 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-32ad3bac17fc4da182401fd0674b4161, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-914020f3714948679271bb1ac4014cbe, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-a3ba9365b9d84749af18cbd50c81216b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-1d5c7a174bfa494e951b974776a92357, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/25b2a71943fa41ddaae37e3f1ef89fa4_SeqId_34_] to archive 2023-02-08 00:58:54,803 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:54,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-32ad3bac17fc4da182401fd0674b4161 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-32ad3bac17fc4da182401fd0674b4161 2023-02-08 00:58:54,806 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-914020f3714948679271bb1ac4014cbe to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-914020f3714948679271bb1ac4014cbe 2023-02-08 00:58:54,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-a3ba9365b9d84749af18cbd50c81216b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-a3ba9365b9d84749af18cbd50c81216b 2023-02-08 00:58:54,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-1d5c7a174bfa494e951b974776a92357 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/testCompactionWithHFileLink=9338368da41aeb4a27fe667e7462918a-1d5c7a174bfa494e951b974776a92357 2023-02-08 00:58:54,809 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/25b2a71943fa41ddaae37e3f1ef89fa4_SeqId_34_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/family1/25b2a71943fa41ddaae37e3f1ef89fa4_SeqId_34_ 2023-02-08 00:58:54,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-7248a2815e884b62be416154b778eb7b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-79201498d5624db5882d048fb42c97bf, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-479cc4f066f0415ab19e454360983796, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-60b77def44d14713bd081b36d6327d3d] to archive 2023-02-08 00:58:54,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:58:54,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-7248a2815e884b62be416154b778eb7b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-7248a2815e884b62be416154b778eb7b 2023-02-08 00:58:54,814 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-79201498d5624db5882d048fb42c97bf to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-79201498d5624db5882d048fb42c97bf 2023-02-08 00:58:54,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-479cc4f066f0415ab19e454360983796 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-479cc4f066f0415ab19e454360983796 2023-02-08 00:58:54,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-60b77def44d14713bd081b36d6327d3d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/family2/testCompactionWithHFileLink=89a0ab87c56c5be47f5c7e5dcda828ee-60b77def44d14713bd081b36d6327d3d 2023-02-08 00:58:54,829 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a9b1b2d3dd6bede138606a2ea05db424, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:54,829 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=27ddb7f5c95f0b9f97df2803a621f3c9, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:54,829 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=2ac42b7db01e98b42cdc33a9b82921f5, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:54,829 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675817934829"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817934829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817934829"}]},"ts":"1675817934829"} 2023-02-08 00:58:54,829 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675817934829"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817934829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817934829"}]},"ts":"1675817934829"} 2023-02-08 00:58:54,829 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675817934829"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817934829"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817934829"}]},"ts":"1675817934829"} 2023-02-08 00:58:54,830 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure 2ac42b7db01e98b42cdc33a9b82921f5, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:54,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=110, ppid=106, state=RUNNABLE; OpenRegionProcedure a9b1b2d3dd6bede138606a2ea05db424, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:54,831 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 27ddb7f5c95f0b9f97df2803a621f3c9, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:58:54,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:58:54,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => a9b1b2d3dd6bede138606a2ea05db424, NAME => 'ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424.', STARTKEY => '', ENDKEY => '1'} 2023-02-08 00:58:54,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction a9b1b2d3dd6bede138606a2ea05db424 2023-02-08 00:58:54,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:54,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for a9b1b2d3dd6bede138606a2ea05db424 2023-02-08 00:58:54,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for a9b1b2d3dd6bede138606a2ea05db424 2023-02-08 00:58:54,985 INFO [StoreOpener-a9b1b2d3dd6bede138606a2ea05db424-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a9b1b2d3dd6bede138606a2ea05db424 2023-02-08 00:58:54,986 DEBUG [StoreOpener-a9b1b2d3dd6bede138606a2ea05db424-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1 2023-02-08 00:58:54,986 DEBUG [StoreOpener-a9b1b2d3dd6bede138606a2ea05db424-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1 2023-02-08 00:58:54,987 INFO [StoreOpener-a9b1b2d3dd6bede138606a2ea05db424-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9b1b2d3dd6bede138606a2ea05db424 columnFamilyName family1 2023-02-08 00:58:54,988 INFO [StoreOpener-a9b1b2d3dd6bede138606a2ea05db424-1] regionserver.HStore(310): Store=a9b1b2d3dd6bede138606a2ea05db424/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:54,988 INFO [StoreOpener-a9b1b2d3dd6bede138606a2ea05db424-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a9b1b2d3dd6bede138606a2ea05db424 2023-02-08 00:58:54,989 DEBUG [StoreOpener-a9b1b2d3dd6bede138606a2ea05db424-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2 2023-02-08 00:58:54,989 DEBUG [StoreOpener-a9b1b2d3dd6bede138606a2ea05db424-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2 2023-02-08 00:58:54,989 INFO [StoreOpener-a9b1b2d3dd6bede138606a2ea05db424-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a9b1b2d3dd6bede138606a2ea05db424 columnFamilyName family2 2023-02-08 00:58:54,990 INFO [StoreOpener-a9b1b2d3dd6bede138606a2ea05db424-1] regionserver.HStore(310): Store=a9b1b2d3dd6bede138606a2ea05db424/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:54,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424 2023-02-08 00:58:54,991 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424 2023-02-08 00:58:54,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:58:54,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for a9b1b2d3dd6bede138606a2ea05db424 2023-02-08 00:58:54,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:58:54,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened a9b1b2d3dd6bede138606a2ea05db424; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75237553, jitterRate=0.12112690508365631}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:58:54,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for a9b1b2d3dd6bede138606a2ea05db424: Running coprocessor pre-open hook at 1675817934984Writing region info on filesystem at 1675817934984Initializing all the Stores at 1675817934985 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817934985Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817934985Cleaning up temporary data from old regions at 1675817934992 (+7 ms)Cleaning up detritus from prior splits at 1675817934993 (+1 ms)Running coprocessor post-open hooks at 1675817934997 (+4 ms)Region opened successfully at 1675817934997 2023-02-08 00:58:54,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424., pid=110, masterSystemTime=1675817934981 2023-02-08 00:58:54,998 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:58:54,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:58:54,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:58:54,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 2ac42b7db01e98b42cdc33a9b82921f5, NAME => 'ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5.', STARTKEY => '2', ENDKEY => ''} 2023-02-08 00:58:54,999 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a9b1b2d3dd6bede138606a2ea05db424, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:54,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 2ac42b7db01e98b42cdc33a9b82921f5 2023-02-08 00:58:54,999 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675817934999"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817934999"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817934999"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817934999"}]},"ts":"1675817934999"} 2023-02-08 00:58:54,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:54,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 2ac42b7db01e98b42cdc33a9b82921f5 2023-02-08 00:58:54,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 2ac42b7db01e98b42cdc33a9b82921f5 2023-02-08 00:58:55,000 INFO [StoreOpener-2ac42b7db01e98b42cdc33a9b82921f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2ac42b7db01e98b42cdc33a9b82921f5 2023-02-08 00:58:55,001 DEBUG [StoreOpener-2ac42b7db01e98b42cdc33a9b82921f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1 2023-02-08 00:58:55,001 DEBUG [StoreOpener-2ac42b7db01e98b42cdc33a9b82921f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1 2023-02-08 00:58:55,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=110, resume processing ppid=106 2023-02-08 00:58:55,001 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, ppid=106, state=SUCCESS; OpenRegionProcedure a9b1b2d3dd6bede138606a2ea05db424, server=jenkins-hbase12.apache.org,36907,1675817727419 in 169 msec 2023-02-08 00:58:55,001 INFO [StoreOpener-2ac42b7db01e98b42cdc33a9b82921f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ac42b7db01e98b42cdc33a9b82921f5 columnFamilyName family1 2023-02-08 00:58:55,002 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a9b1b2d3dd6bede138606a2ea05db424, ASSIGN in 331 msec 2023-02-08 00:58:55,002 INFO [StoreOpener-2ac42b7db01e98b42cdc33a9b82921f5-1] regionserver.HStore(310): Store=2ac42b7db01e98b42cdc33a9b82921f5/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:55,002 INFO [StoreOpener-2ac42b7db01e98b42cdc33a9b82921f5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2ac42b7db01e98b42cdc33a9b82921f5 2023-02-08 00:58:55,003 DEBUG [StoreOpener-2ac42b7db01e98b42cdc33a9b82921f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2 2023-02-08 00:58:55,003 DEBUG [StoreOpener-2ac42b7db01e98b42cdc33a9b82921f5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2 2023-02-08 00:58:55,003 INFO [StoreOpener-2ac42b7db01e98b42cdc33a9b82921f5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2ac42b7db01e98b42cdc33a9b82921f5 columnFamilyName family2 2023-02-08 00:58:55,004 INFO [StoreOpener-2ac42b7db01e98b42cdc33a9b82921f5-1] regionserver.HStore(310): Store=2ac42b7db01e98b42cdc33a9b82921f5/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:55,004 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5 2023-02-08 00:58:55,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5 2023-02-08 00:58:55,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:58:55,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 2ac42b7db01e98b42cdc33a9b82921f5 2023-02-08 00:58:55,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:58:55,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 2ac42b7db01e98b42cdc33a9b82921f5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66463907, jitterRate=-0.009610608220100403}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:58:55,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 2ac42b7db01e98b42cdc33a9b82921f5: Running coprocessor pre-open hook at 1675817934999Writing region info on filesystem at 1675817934999Initializing all the Stores at 1675817935000 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817935000Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817935000Cleaning up temporary data from old regions at 1675817935005 (+5 ms)Cleaning up detritus from prior splits at 1675817935005Running coprocessor post-open hooks at 1675817935008 (+3 ms)Region opened successfully at 1675817935008 2023-02-08 00:58:55,009 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5., pid=109, masterSystemTime=1675817934981 2023-02-08 00:58:55,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:58:55,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:58:55,010 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:58:55,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 27ddb7f5c95f0b9f97df2803a621f3c9, NAME => 'ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9.', STARTKEY => '1', ENDKEY => '2'} 2023-02-08 00:58:55,010 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=2ac42b7db01e98b42cdc33a9b82921f5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:55,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 27ddb7f5c95f0b9f97df2803a621f3c9 2023-02-08 00:58:55,010 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1675817935010"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817935010"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817935010"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817935010"}]},"ts":"1675817935010"} 2023-02-08 00:58:55,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:58:55,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 27ddb7f5c95f0b9f97df2803a621f3c9 2023-02-08 00:58:55,010 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 27ddb7f5c95f0b9f97df2803a621f3c9 2023-02-08 00:58:55,011 INFO [StoreOpener-27ddb7f5c95f0b9f97df2803a621f3c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 27ddb7f5c95f0b9f97df2803a621f3c9 2023-02-08 00:58:55,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=108 2023-02-08 00:58:55,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure 2ac42b7db01e98b42cdc33a9b82921f5, server=jenkins-hbase12.apache.org,36907,1675817727419 in 181 msec 2023-02-08 00:58:55,012 DEBUG [StoreOpener-27ddb7f5c95f0b9f97df2803a621f3c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1 2023-02-08 00:58:55,012 DEBUG [StoreOpener-27ddb7f5c95f0b9f97df2803a621f3c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1 2023-02-08 00:58:55,012 INFO [StoreOpener-27ddb7f5c95f0b9f97df2803a621f3c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27ddb7f5c95f0b9f97df2803a621f3c9 columnFamilyName family1 2023-02-08 00:58:55,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=2ac42b7db01e98b42cdc33a9b82921f5, ASSIGN in 342 msec 2023-02-08 00:58:55,013 INFO [StoreOpener-27ddb7f5c95f0b9f97df2803a621f3c9-1] regionserver.HStore(310): Store=27ddb7f5c95f0b9f97df2803a621f3c9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:55,014 INFO [StoreOpener-27ddb7f5c95f0b9f97df2803a621f3c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 27ddb7f5c95f0b9f97df2803a621f3c9 2023-02-08 00:58:55,014 DEBUG [StoreOpener-27ddb7f5c95f0b9f97df2803a621f3c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2 2023-02-08 00:58:55,014 DEBUG [StoreOpener-27ddb7f5c95f0b9f97df2803a621f3c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2 2023-02-08 00:58:55,015 INFO [StoreOpener-27ddb7f5c95f0b9f97df2803a621f3c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27ddb7f5c95f0b9f97df2803a621f3c9 columnFamilyName family2 2023-02-08 00:58:55,015 INFO [StoreOpener-27ddb7f5c95f0b9f97df2803a621f3c9-1] regionserver.HStore(310): Store=27ddb7f5c95f0b9f97df2803a621f3c9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:58:55,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9 2023-02-08 00:58:55,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9 2023-02-08 00:58:55,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:58:55,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 27ddb7f5c95f0b9f97df2803a621f3c9 2023-02-08 00:58:55,019 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:58:55,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 27ddb7f5c95f0b9f97df2803a621f3c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63063165, jitterRate=-0.06028561294078827}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:58:55,020 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 27ddb7f5c95f0b9f97df2803a621f3c9: Running coprocessor pre-open hook at 1675817935010Writing region info on filesystem at 1675817935010Initializing all the Stores at 1675817935011 (+1 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817935011Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817935011Cleaning up temporary data from old regions at 1675817935017 (+6 ms)Cleaning up detritus from prior splits at 1675817935017Running coprocessor post-open hooks at 1675817935020 (+3 ms)Region opened successfully at 1675817935020 2023-02-08 00:58:55,020 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9., pid=111, masterSystemTime=1675817934981 2023-02-08 00:58:55,021 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:58:55,021 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:58:55,022 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=27ddb7f5c95f0b9f97df2803a621f3c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:55,022 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1675817935022"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817935022"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817935022"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817935022"}]},"ts":"1675817935022"} 2023-02-08 00:58:55,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=111, resume processing ppid=107 2023-02-08 00:58:55,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 27ddb7f5c95f0b9f97df2803a621f3c9, server=jenkins-hbase12.apache.org,36907,1675817727419 in 192 msec 2023-02-08 00:58:55,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-02-08 00:58:55,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=27ddb7f5c95f0b9f97df2803a621f3c9, ASSIGN in 354 msec 2023-02-08 00:58:55,025 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 00:58:55,026 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817935025"}]},"ts":"1675817935025"} 2023-02-08 00:58:55,026 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-02-08 00:58:55,157 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 00:58:55,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.5980 sec 2023-02-08 00:58:55,675 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:55,675 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:55,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=105 2023-02-08 00:58:55,677 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-02-08 00:58:55,684 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:55,685 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:55,685 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:55,687 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:55,687 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:55,688 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:58:55,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-08 00:58:55,691 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-08 00:58:55,691 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:55,691 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-08 00:58:55,691 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-08 00:58:55,691 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:58:55,691 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:58:55,920 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-02-08 00:58:55,924 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:55,924 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:55,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:55,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:55,924 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:55,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:58:55,924 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:58:55,925 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:58:55,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:58:55,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:58:55,926 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-08 00:58:55,926 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-08 00:58:55,926 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-08 00:58:55,926 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:55,926 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-08 00:58:55,927 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:58:55,927 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:58:55,927 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. started... 2023-02-08 00:58:55,927 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:58:55,927 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:58:55,927 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. started... 2023-02-08 00:58:55,929 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2ac42b7db01e98b42cdc33a9b82921f5 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 00:58:55,927 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:58:55,930 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 27ddb7f5c95f0b9f97df2803a621f3c9 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 00:58:55,930 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. started... 2023-02-08 00:58:55,930 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a9b1b2d3dd6bede138606a2ea05db424 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 00:58:56,345 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208385b1b1d32de419f8069d299bb3724d9 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230208385b1b1d32de419f8069d299bb3724d9 2023-02-08 00:58:56,345 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208fd75a99ed756478696dc6538e002dfdc to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230208fd75a99ed756478696dc6538e002dfdc 2023-02-08 00:58:56,345 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302087176d932ae544ca38b34263ff84898c4 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302087176d932ae544ca38b34263ff84898c4 2023-02-08 00:58:56,752 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family1/2164a3ff99e64f97bc1169cf36ec53c7 2023-02-08 00:58:56,753 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family1/a08d10e6b22f4987be840b448c1012ed 2023-02-08 00:58:56,752 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family1/5556aebc4a194e26ac86d766ab3b3b39 2023-02-08 00:58:57,177 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208cc964538e1b746f5bddcdced6697b2d6 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230208cc964538e1b746f5bddcdced6697b2d6 2023-02-08 00:58:57,177 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302083a3e3a8625c842ccbb0e22d70e957053 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302083a3e3a8625c842ccbb0e22d70e957053 2023-02-08 00:58:57,185 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208a2ad7ffcbc7047b185e53fc78f011b37 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20230208a2ad7ffcbc7047b185e53fc78f011b37 2023-02-08 00:58:57,587 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family2/d8a719e1e70f4115ba51c0892e5fd1ce 2023-02-08 00:58:57,587 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family2/d0d372978bd447e18bf613cdfb7e2084 2023-02-08 00:58:57,592 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family2/c268039cb5a8480f8e2e6f1b2f7f4aba 2023-02-08 00:58:57,593 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family1/5556aebc4a194e26ac86d766ab3b3b39 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/5556aebc4a194e26ac86d766ab3b3b39 2023-02-08 00:58:57,593 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family1/a08d10e6b22f4987be840b448c1012ed as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/a08d10e6b22f4987be840b448c1012ed 2023-02-08 00:58:57,597 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family1/2164a3ff99e64f97bc1169cf36ec53c7 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/2164a3ff99e64f97bc1169cf36ec53c7 2023-02-08 00:58:57,598 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/a08d10e6b22f4987be840b448c1012ed, entries=4, sequenceid=5, filesize=5.4 K 2023-02-08 00:58:57,598 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/5556aebc4a194e26ac86d766ab3b3b39, entries=4, sequenceid=5, filesize=5.4 K 2023-02-08 00:58:57,598 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family2/d8a719e1e70f4115ba51c0892e5fd1ce as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/d8a719e1e70f4115ba51c0892e5fd1ce 2023-02-08 00:58:57,599 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family2/d0d372978bd447e18bf613cdfb7e2084 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/d0d372978bd447e18bf613cdfb7e2084 2023-02-08 00:58:57,602 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/2164a3ff99e64f97bc1169cf36ec53c7, entries=4, sequenceid=5, filesize=5.4 K 2023-02-08 00:58:57,603 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family2/c268039cb5a8480f8e2e6f1b2f7f4aba as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/c268039cb5a8480f8e2e6f1b2f7f4aba 2023-02-08 00:58:57,603 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/d8a719e1e70f4115ba51c0892e5fd1ce, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 00:58:57,603 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/d0d372978bd447e18bf613cdfb7e2084, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 00:58:57,604 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 27ddb7f5c95f0b9f97df2803a621f3c9 in 1675ms, sequenceid=5, compaction requested=false 2023-02-08 00:58:57,604 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a9b1b2d3dd6bede138606a2ea05db424 in 1674ms, sequenceid=5, compaction requested=false 2023-02-08 00:58:57,604 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 27ddb7f5c95f0b9f97df2803a621f3c9: 2023-02-08 00:58:57,604 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a9b1b2d3dd6bede138606a2ea05db424: 2023-02-08 00:58:57,604 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:58:57,605 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:58:57,605 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:58:57,605 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:58:57,606 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/c268039cb5a8480f8e2e6f1b2f7f4aba, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 00:58:57,607 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2ac42b7db01e98b42cdc33a9b82921f5 in 1678ms, sequenceid=5, compaction requested=false 2023-02-08 00:58:57,607 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2ac42b7db01e98b42cdc33a9b82921f5: 2023-02-08 00:58:57,607 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:58:57,607 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:58:57,607 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:58:57,607 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:57,607 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-08 00:58:57,607 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-08 00:58:57,850 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:57,850 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:58:57,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:57,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:57,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:57,850 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:58:57,851 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:58:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:58:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:57,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-08 00:58:57,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@687c3dca[Count = 0] remaining members to acquire global barrier 2023-02-08 00:58:57,853 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-08 00:58:57,853 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:58:58,115 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:58:58,115 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:58:58,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:58:58,115 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-08 00:58:58,115 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-08 00:58:58,115 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:58:58,116 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:58,116 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:58:58,145 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:58,145 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-08 00:58:58,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:58,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:58,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:58,146 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:58,146 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-08 00:58:58,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:58,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:58,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:58:58,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:58,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:58,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:58:58,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:58,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:58:58,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-08 00:58:58,152 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-08 00:58:58,153 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:58:58,153 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:58:58,153 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-08 00:58:58,153 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:58:58,170 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:58:58,170 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:58:58,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:58:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:58:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:58:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:58:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:58:58,170 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:58,170 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:58,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:58,171 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:58:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:58:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:58:58,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:58:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:58:58,172 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:58,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:58:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:58:58,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:58,440 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:58,440 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:58,440 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:58:58,440 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:58:58,440 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-08 00:58:58,441 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:58:58,441 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:58,441 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:58:58,441 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:58:58,442 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:58:58,440 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-08 00:58:58,442 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:58:58,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:58,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:58,440 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:58:58,443 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-08 00:58:58,443 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:58:58,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:58:58,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:58:58,543 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:58:58,544 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:58,544 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:58,546 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:58:58,549 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:58,549 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:58,550 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:58:58,553 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:58:58,553 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:58:58,555 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:58:58,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-08 00:58:58,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-08 00:58:58,557 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-08 00:58:58,557 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:58,557 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-08 00:58:58,558 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-08 00:58:58,558 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:58:58,558 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:58:58,766 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:58:58,766 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:58,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:58:58,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:58:58,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:58:58,766 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:58:58,767 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:58:58,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:58:58,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:58:58,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:58:58,767 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-08 00:58:58,768 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-08 00:58:58,768 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-08 00:58:58,768 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-08 00:58:58,768 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:58:58,768 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-08 00:58:58,768 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:58:58,768 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:58:58,768 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:58:58,768 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:58:58,768 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. started... 2023-02-08 00:58:58,768 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. started... 2023-02-08 00:58:58,768 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:58:58,768 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2ac42b7db01e98b42cdc33a9b82921f5 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 00:58:58,768 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. started... 2023-02-08 00:58:58,768 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 27ddb7f5c95f0b9f97df2803a621f3c9 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 00:58:58,769 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a9b1b2d3dd6bede138606a2ea05db424 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 00:58:58,783 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208893693fee2334fb7854f0a9b674be450 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230208893693fee2334fb7854f0a9b674be450 2023-02-08 00:58:59,186 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208706db541ef2e4f56ac59ad0a92b336cb to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230208706db541ef2e4f56ac59ad0a92b336cb 2023-02-08 00:58:59,186 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020891745ec78834474eb974046b7d95272d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023020891745ec78834474eb974046b7d95272d 2023-02-08 00:58:59,187 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family1/d2d96d9620de4b6b9f99cb156d807c0b 2023-02-08 00:58:59,597 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family1/615277c4dacc48ad96b9e670676643ac 2023-02-08 00:58:59,599 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family1/76bbb166a37242aea47d0b2c476f02db 2023-02-08 00:58:59,608 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208a0630f0b679f4fffaf2b4407037377d6 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20230208a0630f0b679f4fffaf2b4407037377d6 2023-02-08 00:59:00,028 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family2/83fb2acb7c0e4033beb679c3ac50a085 2023-02-08 00:59:00,031 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302084d22e816577e4afaa549c015d151a1ea to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302084d22e816577e4afaa549c015d151a1ea 2023-02-08 00:59:00,031 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302087b9d0312251f4ea4ae7fe84a81df9f0f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302087b9d0312251f4ea4ae7fe84a81df9f0f 2023-02-08 00:59:00,032 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family1/d2d96d9620de4b6b9f99cb156d807c0b as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/d2d96d9620de4b6b9f99cb156d807c0b 2023-02-08 00:59:00,036 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/d2d96d9620de4b6b9f99cb156d807c0b, entries=4, sequenceid=9, filesize=5.4 K 2023-02-08 00:59:00,037 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family2/83fb2acb7c0e4033beb679c3ac50a085 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/83fb2acb7c0e4033beb679c3ac50a085 2023-02-08 00:59:00,040 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/83fb2acb7c0e4033beb679c3ac50a085, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 00:59:00,041 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a9b1b2d3dd6bede138606a2ea05db424 in 1272ms, sequenceid=9, compaction requested=false 2023-02-08 00:59:00,041 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a9b1b2d3dd6bede138606a2ea05db424: 2023-02-08 00:59:00,041 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:59:00,041 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:59:00,437 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family2/192053737e7542ca8ac88e658f34e4ac 2023-02-08 00:59:00,437 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family2/cba43e8963b445a788806c10147ed298 2023-02-08 00:59:00,441 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family1/615277c4dacc48ad96b9e670676643ac as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/615277c4dacc48ad96b9e670676643ac 2023-02-08 00:59:00,441 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family1/76bbb166a37242aea47d0b2c476f02db as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/76bbb166a37242aea47d0b2c476f02db 2023-02-08 00:59:00,444 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/76bbb166a37242aea47d0b2c476f02db, entries=4, sequenceid=9, filesize=5.4 K 2023-02-08 00:59:00,444 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/615277c4dacc48ad96b9e670676643ac, entries=4, sequenceid=9, filesize=5.4 K 2023-02-08 00:59:00,445 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family2/cba43e8963b445a788806c10147ed298 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/cba43e8963b445a788806c10147ed298 2023-02-08 00:59:00,445 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family2/192053737e7542ca8ac88e658f34e4ac as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/192053737e7542ca8ac88e658f34e4ac 2023-02-08 00:59:00,449 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/cba43e8963b445a788806c10147ed298, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 00:59:00,449 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/192053737e7542ca8ac88e658f34e4ac, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 00:59:00,450 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2ac42b7db01e98b42cdc33a9b82921f5 in 1682ms, sequenceid=9, compaction requested=false 2023-02-08 00:59:00,450 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 27ddb7f5c95f0b9f97df2803a621f3c9 in 1682ms, sequenceid=9, compaction requested=false 2023-02-08 00:59:00,450 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2ac42b7db01e98b42cdc33a9b82921f5: 2023-02-08 00:59:00,450 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 27ddb7f5c95f0b9f97df2803a621f3c9: 2023-02-08 00:59:00,450 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:59:00,450 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:59:00,450 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:59:00,450 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:59:00,450 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:59:00,450 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:00,450 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-08 00:59:00,450 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-08 00:59:00,486 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:59:00,809 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:00,809 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:00,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:00,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:00,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:00,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:00,812 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:00,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:00,812 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:00,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:00,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:00,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-08 00:59:00,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c477500[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:00,815 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-08 00:59:00,815 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:00,843 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:00,843 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:00,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:00,844 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:00,844 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:00,844 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-08 00:59:00,844 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-08 00:59:00,844 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:00,851 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-08 00:59:00,851 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:00,851 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:00,851 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-08 00:59:00,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:00,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:00,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:00,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:00,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:00,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:00,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:00,854 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-08 00:59:00,854 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-08 00:59:00,854 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:00,854 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:00,854 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-08 00:59:00,854 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:00,871 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:00,871 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:00,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:00,871 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:00,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:00,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:00,872 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:00,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:00,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:00,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:00,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:00,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:00,873 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:00,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:00,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:00,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:00,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:01,191 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:01,191 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:01,191 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:01,191 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:01,191 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:01,191 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:01,191 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:01,191 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:01,191 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-08 00:59:01,191 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:01,191 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:01,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:01,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:01,191 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:01,191 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:01,191 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:01,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:01,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:01,291 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:01,292 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:01,292 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:01,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:01,296 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:01,296 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:01,296 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:01,300 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:01,301 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:01,302 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:01,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:01,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-08 00:59:01,304 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-08 00:59:01,304 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:01,304 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-08 00:59:01,304 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-08 00:59:01,305 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:01,305 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:01,386 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:01,386 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:01,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:01,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:01,387 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:01,387 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:01,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:01,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:01,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:01,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:01,389 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-08 00:59:01,389 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-08 00:59:01,390 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-08 00:59:01,390 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-08 00:59:01,390 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:01,390 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-08 00:59:01,390 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:59:01,391 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. started... 2023-02-08 00:59:01,391 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:59:01,391 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. started... 2023-02-08 00:59:01,391 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:59:01,391 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:59:01,391 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:01,391 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2ac42b7db01e98b42cdc33a9b82921f5 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 00:59:01,391 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. started... 2023-02-08 00:59:01,391 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 27ddb7f5c95f0b9f97df2803a621f3c9 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 00:59:01,392 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a9b1b2d3dd6bede138606a2ea05db424 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 00:59:01,815 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302086770205f1e414dcb9c03f201a3715d9b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302086770205f1e414dcb9c03f201a3715d9b 2023-02-08 00:59:01,815 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208359fa91d358b4979b183083b542693ed to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230208359fa91d358b4979b183083b542693ed 2023-02-08 00:59:01,815 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302089efdf46d22894523b610115f7608bde0 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302089efdf46d22894523b610115f7608bde0 2023-02-08 00:59:01,831 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:59:01,831 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56bb74b2 to 127.0.0.1:49726 2023-02-08 00:59:01,831 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:59:01,832 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:59:01,832 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x534804c5 to 127.0.0.1:49726 2023-02-08 00:59:01,832 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:59:02,233 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family1/8c13f8717a8442ed978802da0074335a 2023-02-08 00:59:02,233 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family1/175178ef0eab45179f9581ef3e657fa4 2023-02-08 00:59:02,234 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family1/c33a4cf375f84e5e86e047f20c4fe5d5 2023-02-08 00:59:02,648 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020866c138cc31814ef297dbeced779f25a4 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023020866c138cc31814ef297dbeced779f25a4 2023-02-08 00:59:02,649 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208e76682b76d60478fa44233d5d2e7eb9a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230208e76682b76d60478fa44233d5d2e7eb9a 2023-02-08 00:59:02,649 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302088acbbd093b9e4a34b7630254ee24e841 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302088acbbd093b9e4a34b7630254ee24e841 2023-02-08 00:59:02,655 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family2/cd70769f457f4c45badbb63347103882 2023-02-08 00:59:02,655 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family2/49890bc2d8f246fc850ca4b2d2eaf485 2023-02-08 00:59:02,655 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family2/a52670338e74470bb10377af3f1ce79f 2023-02-08 00:59:02,659 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family1/c33a4cf375f84e5e86e047f20c4fe5d5 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/c33a4cf375f84e5e86e047f20c4fe5d5 2023-02-08 00:59:02,659 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family1/8c13f8717a8442ed978802da0074335a as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/8c13f8717a8442ed978802da0074335a 2023-02-08 00:59:02,659 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family1/175178ef0eab45179f9581ef3e657fa4 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/175178ef0eab45179f9581ef3e657fa4 2023-02-08 00:59:02,662 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/8c13f8717a8442ed978802da0074335a, entries=4, sequenceid=13, filesize=5.4 K 2023-02-08 00:59:02,662 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/c33a4cf375f84e5e86e047f20c4fe5d5, entries=4, sequenceid=13, filesize=5.4 K 2023-02-08 00:59:02,662 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/175178ef0eab45179f9581ef3e657fa4, entries=4, sequenceid=13, filesize=5.4 K 2023-02-08 00:59:02,663 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family2/cd70769f457f4c45badbb63347103882 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/cd70769f457f4c45badbb63347103882 2023-02-08 00:59:02,663 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family2/a52670338e74470bb10377af3f1ce79f as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/a52670338e74470bb10377af3f1ce79f 2023-02-08 00:59:02,663 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family2/49890bc2d8f246fc850ca4b2d2eaf485 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/49890bc2d8f246fc850ca4b2d2eaf485 2023-02-08 00:59:02,667 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/cd70769f457f4c45badbb63347103882, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 00:59:02,667 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/49890bc2d8f246fc850ca4b2d2eaf485, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 00:59:02,667 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/a52670338e74470bb10377af3f1ce79f, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 00:59:02,668 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a9b1b2d3dd6bede138606a2ea05db424 in 1276ms, sequenceid=13, compaction requested=true 2023-02-08 00:59:02,668 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 27ddb7f5c95f0b9f97df2803a621f3c9 in 1277ms, sequenceid=13, compaction requested=true 2023-02-08 00:59:02,668 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a9b1b2d3dd6bede138606a2ea05db424: 2023-02-08 00:59:02,668 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2ac42b7db01e98b42cdc33a9b82921f5 in 1277ms, sequenceid=13, compaction requested=true 2023-02-08 00:59:02,668 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 27ddb7f5c95f0b9f97df2803a621f3c9: 2023-02-08 00:59:02,668 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2ac42b7db01e98b42cdc33a9b82921f5: 2023-02-08 00:59:02,668 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:59:02,668 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:59:02,668 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:59:02,668 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:59:02,668 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:59:02,668 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:59:02,668 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:59:02,668 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:02,668 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-08 00:59:02,668 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-08 00:59:02,797 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:02,797 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:02,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:02,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:02,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:02,798 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:02,798 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:02,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:02,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:02,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:02,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:02,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:02,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-08 00:59:02,801 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7d3bb5f3[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:02,801 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-08 00:59:02,802 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:02,881 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:02,882 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:02,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:02,882 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-08 00:59:02,882 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-08 00:59:02,882 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:02,882 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:02,882 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:02,955 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:02,955 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-08 00:59:02,955 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:02,955 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-08 00:59:02,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:02,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:02,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:02,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:02,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:02,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:02,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:02,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:02,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:02,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:02,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:02,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-08 00:59:02,965 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-08 00:59:02,966 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:02,966 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:02,966 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-08 00:59:02,966 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:03,321 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:03,321 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:03,321 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:03,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:03,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:03,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:03,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:03,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:03,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:03,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:03,323 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:03,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:03,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:03,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:03,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:03,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:03,327 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:03,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:03,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:03,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:03,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:03,422 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:03,422 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:03,423 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:03,423 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:03,423 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:03,423 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-08 00:59:03,423 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:03,422 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:03,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:03,423 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-08 00:59:03,423 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:03,424 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:03,424 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:03,424 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:03,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:03,424 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:03,424 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:03,425 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:03,425 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:03,525 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:03,525 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:03,525 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:03,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:03,529 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:03,530 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:03,530 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(8801): writing data to region ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:03,534 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:03,534 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:03,535 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:03,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:03,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-08 00:59:03,537 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-08 00:59:03,537 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:03,538 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-08 00:59:03,538 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-08 00:59:03,538 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:03,538 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:03,681 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:03,681 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:03,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:03,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:03,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:03,682 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:03,682 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:03,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:03,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:03,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:03,683 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-08 00:59:03,684 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-08 00:59:03,684 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-08 00:59:03,684 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-08 00:59:03,684 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:03,684 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-08 00:59:03,685 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:59:03,685 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. started... 2023-02-08 00:59:03,685 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:59:03,685 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:03,685 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:59:03,685 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 27ddb7f5c95f0b9f97df2803a621f3c9 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 00:59:03,685 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:59:03,685 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. started... 2023-02-08 00:59:03,685 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. started... 2023-02-08 00:59:03,686 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a9b1b2d3dd6bede138606a2ea05db424 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 00:59:03,686 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2ac42b7db01e98b42cdc33a9b82921f5 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 00:59:04,102 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302082725d92bdac64bfd9ca2eed07ac660ec to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302082725d92bdac64bfd9ca2eed07ac660ec 2023-02-08 00:59:04,103 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208f81911c6d3084885b3a320b96b4f145a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230208f81911c6d3084885b3a320b96b4f145a 2023-02-08 00:59:04,103 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208bb2bb19fd81846c1a3b73d1f88497125 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230208bb2bb19fd81846c1a3b73d1f88497125 2023-02-08 00:59:04,108 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family1/63c8412846cb408e9c0b27fe2bc7a85a 2023-02-08 00:59:04,108 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family1/71ef50c361ba44ac97603bf7ec23cc85 2023-02-08 00:59:04,509 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family1/b4968cb20e99476db1da00589d9e323c 2023-02-08 00:59:04,526 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302089533e3f5bf344cd9ba3bf2963956e07e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202302089533e3f5bf344cd9ba3bf2963956e07e 2023-02-08 00:59:04,526 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302084204ddd128a343a689e2d929ea7f5ac1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202302084204ddd128a343a689e2d929ea7f5ac1 2023-02-08 00:59:04,530 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302080c5516feb0d1421b8252e6505cd9f09d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202302080c5516feb0d1421b8252e6505cd9f09d 2023-02-08 00:59:04,531 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family2/b7050f0ef02b4475b7d5444c67912c97 2023-02-08 00:59:04,535 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family1/63c8412846cb408e9c0b27fe2bc7a85a as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/63c8412846cb408e9c0b27fe2bc7a85a 2023-02-08 00:59:04,538 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/63c8412846cb408e9c0b27fe2bc7a85a, entries=4, sequenceid=17, filesize=5.4 K 2023-02-08 00:59:04,539 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family2/b7050f0ef02b4475b7d5444c67912c97 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/b7050f0ef02b4475b7d5444c67912c97 2023-02-08 00:59:04,542 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/b7050f0ef02b4475b7d5444c67912c97, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 00:59:04,542 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 27ddb7f5c95f0b9f97df2803a621f3c9 in 857ms, sequenceid=17, compaction requested=true 2023-02-08 00:59:04,542 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 27ddb7f5c95f0b9f97df2803a621f3c9: 2023-02-08 00:59:04,542 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:59:04,543 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:59:04,932 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family2/e194a1db55a54b519fe67c4afe1691c2 2023-02-08 00:59:04,935 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family2/0955f765fee34f0ea8211b68e8634a80 2023-02-08 00:59:04,939 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family1/71ef50c361ba44ac97603bf7ec23cc85 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/71ef50c361ba44ac97603bf7ec23cc85 2023-02-08 00:59:04,942 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family1/b4968cb20e99476db1da00589d9e323c as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/b4968cb20e99476db1da00589d9e323c 2023-02-08 00:59:04,945 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/71ef50c361ba44ac97603bf7ec23cc85, entries=4, sequenceid=17, filesize=5.4 K 2023-02-08 00:59:04,946 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family2/e194a1db55a54b519fe67c4afe1691c2 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/e194a1db55a54b519fe67c4afe1691c2 2023-02-08 00:59:04,948 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/b4968cb20e99476db1da00589d9e323c, entries=4, sequenceid=17, filesize=5.4 K 2023-02-08 00:59:04,949 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family2/0955f765fee34f0ea8211b68e8634a80 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/0955f765fee34f0ea8211b68e8634a80 2023-02-08 00:59:04,952 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/e194a1db55a54b519fe67c4afe1691c2, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 00:59:04,952 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2ac42b7db01e98b42cdc33a9b82921f5 in 1266ms, sequenceid=17, compaction requested=true 2023-02-08 00:59:04,953 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2ac42b7db01e98b42cdc33a9b82921f5: 2023-02-08 00:59:04,953 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:59:04,953 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:59:04,954 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/0955f765fee34f0ea8211b68e8634a80, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 00:59:04,955 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a9b1b2d3dd6bede138606a2ea05db424 in 1269ms, sequenceid=17, compaction requested=true 2023-02-08 00:59:04,955 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a9b1b2d3dd6bede138606a2ea05db424: 2023-02-08 00:59:04,955 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:59:04,955 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:59:04,955 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:59:04,955 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:04,956 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-08 00:59:04,956 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-08 00:59:05,039 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:05,039 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:05,040 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:05,040 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:05,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:05,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:05,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:05,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:05,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-08 00:59:05,044 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@216360df[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:05,044 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-08 00:59:05,044 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:05,060 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:05,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:05,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:05,060 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-08 00:59:05,060 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-08 00:59:05,060 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:05,060 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,060 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:05,071 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-08 00:59:05,071 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:05,071 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-08 00:59:05,071 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:05,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:05,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:05,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:05,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:05,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:05,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:05,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:05,074 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-08 00:59:05,074 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-08 00:59:05,074 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:05,074 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:05,074 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-08 00:59:05,074 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:05,092 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:05,092 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:05,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:05,092 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:05,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:05,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:05,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:05,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:05,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:05,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:05,093 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:05,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:05,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:05,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:05,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:05,095 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:05,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:05,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,432 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,432 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:05,432 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:05,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:05,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:05,432 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-08 00:59:05,433 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:05,432 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:05,432 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:05,433 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-08 00:59:05,433 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:05,433 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:05,433 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:05,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:05,434 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:05,433 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,434 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:05,434 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:05,434 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:05,534 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:05,534 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:05,534 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:05,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:05,543 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:59:05,550 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:59:05,563 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:59:05,567 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:59:05,594 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:05,595 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:05,595 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:05,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:05,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-02-08 00:59:05,600 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-02-08 00:59:05,600 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:05,600 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-02-08 00:59:05,600 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-02-08 00:59:05,600 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:05,600 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:05,765 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:05,765 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:05,766 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:05,766 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:05,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:05,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:05,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:05,767 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-02-08 00:59:05,767 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-02-08 00:59:05,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-02-08 00:59:05,767 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-02-08 00:59:05,768 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:05,768 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-02-08 00:59:05,768 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:59:05,768 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:59:05,768 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:59:05,768 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:05,768 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. started... 2023-02-08 00:59:05,768 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:59:05,768 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. started... 2023-02-08 00:59:05,768 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 27ddb7f5c95f0b9f97df2803a621f3c9 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 00:59:05,768 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing 2ac42b7db01e98b42cdc33a9b82921f5 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 00:59:05,768 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. started... 2023-02-08 00:59:05,768 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing a9b1b2d3dd6bede138606a2ea05db424 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 00:59:06,589 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family1/783e2bde1df74456857c7df49fa5825f 2023-02-08 00:59:06,596 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family1/b2d5441e609a4badaa23005f2c9c0b5b 2023-02-08 00:59:06,596 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family1/27bb82fc8ac348e4bb290b5a5c9afddf 2023-02-08 00:59:06,596 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 783e2bde1df74456857c7df49fa5825f 2023-02-08 00:59:06,599 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2d5441e609a4badaa23005f2c9c0b5b 2023-02-08 00:59:06,600 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27bb82fc8ac348e4bb290b5a5c9afddf 2023-02-08 00:59:07,013 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family2/bbb0d314a0494a6eafe58d4630365786 2023-02-08 00:59:07,016 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family2/75496c0c502c4abb82c74ddd05b6c6f6 2023-02-08 00:59:07,017 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bbb0d314a0494a6eafe58d4630365786 2023-02-08 00:59:07,017 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family1/783e2bde1df74456857c7df49fa5825f as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/783e2bde1df74456857c7df49fa5825f 2023-02-08 00:59:07,020 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75496c0c502c4abb82c74ddd05b6c6f6 2023-02-08 00:59:07,021 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family1/b2d5441e609a4badaa23005f2c9c0b5b as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/b2d5441e609a4badaa23005f2c9c0b5b 2023-02-08 00:59:07,021 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 783e2bde1df74456857c7df49fa5825f 2023-02-08 00:59:07,021 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/783e2bde1df74456857c7df49fa5825f, entries=3, sequenceid=23, filesize=5.0 K 2023-02-08 00:59:07,022 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family2/bbb0d314a0494a6eafe58d4630365786 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/bbb0d314a0494a6eafe58d4630365786 2023-02-08 00:59:07,024 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2d5441e609a4badaa23005f2c9c0b5b 2023-02-08 00:59:07,025 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/b2d5441e609a4badaa23005f2c9c0b5b, entries=3, sequenceid=23, filesize=5.0 K 2023-02-08 00:59:07,025 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family2/75496c0c502c4abb82c74ddd05b6c6f6 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/75496c0c502c4abb82c74ddd05b6c6f6 2023-02-08 00:59:07,026 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bbb0d314a0494a6eafe58d4630365786 2023-02-08 00:59:07,026 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/bbb0d314a0494a6eafe58d4630365786, entries=1, sequenceid=23, filesize=5.0 K 2023-02-08 00:59:07,027 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2ac42b7db01e98b42cdc33a9b82921f5 in 1259ms, sequenceid=23, compaction requested=true 2023-02-08 00:59:07,028 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for 2ac42b7db01e98b42cdc33a9b82921f5: 2023-02-08 00:59:07,028 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:59:07,028 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:59:07,031 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75496c0c502c4abb82c74ddd05b6c6f6 2023-02-08 00:59:07,031 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/75496c0c502c4abb82c74ddd05b6c6f6, entries=1, sequenceid=23, filesize=5.0 K 2023-02-08 00:59:07,032 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a9b1b2d3dd6bede138606a2ea05db424 in 1264ms, sequenceid=23, compaction requested=true 2023-02-08 00:59:07,032 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for a9b1b2d3dd6bede138606a2ea05db424: 2023-02-08 00:59:07,032 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:59:07,033 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:59:07,414 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family2/b2c3f7f0602043c4aa9e8d2188284e8c 2023-02-08 00:59:07,420 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2c3f7f0602043c4aa9e8d2188284e8c 2023-02-08 00:59:07,421 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family1/27bb82fc8ac348e4bb290b5a5c9afddf as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/27bb82fc8ac348e4bb290b5a5c9afddf 2023-02-08 00:59:07,427 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 27bb82fc8ac348e4bb290b5a5c9afddf 2023-02-08 00:59:07,427 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/27bb82fc8ac348e4bb290b5a5c9afddf, entries=3, sequenceid=23, filesize=5.0 K 2023-02-08 00:59:07,428 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family2/b2c3f7f0602043c4aa9e8d2188284e8c as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/b2c3f7f0602043c4aa9e8d2188284e8c 2023-02-08 00:59:07,434 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b2c3f7f0602043c4aa9e8d2188284e8c 2023-02-08 00:59:07,434 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/b2c3f7f0602043c4aa9e8d2188284e8c, entries=1, sequenceid=23, filesize=5.0 K 2023-02-08 00:59:07,435 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 27ddb7f5c95f0b9f97df2803a621f3c9 in 1667ms, sequenceid=23, compaction requested=true 2023-02-08 00:59:07,435 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 27ddb7f5c95f0b9f97df2803a621f3c9: 2023-02-08 00:59:07,435 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:59:07,435 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:59:07,435 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:59:07,435 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:07,435 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-02-08 00:59:07,435 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-02-08 00:59:07,744 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:07,744 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:07,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:07,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:07,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:07,745 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:07,745 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:07,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:07,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:07,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:07,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:07,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:07,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-02-08 00:59:07,747 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28f89b54[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:07,747 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-02-08 00:59:07,747 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:07,820 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:07,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:07,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:07,820 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-02-08 00:59:07,820 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:07,820 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:07,820 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-02-08 00:59:07,820 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:07,844 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-02-08 00:59:07,844 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:07,844 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-02-08 00:59:07,844 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:07,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:07,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:07,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:07,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:07,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:07,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:07,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:07,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:07,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:07,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:07,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:07,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-02-08 00:59:07,846 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-02-08 00:59:07,846 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:07,846 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:07,846 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-02-08 00:59:07,846 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:08,166 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:08,166 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:08,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:08,166 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:08,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:08,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:08,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:08,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:08,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:08,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:08,168 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:08,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:08,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:08,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:08,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:08,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:08,171 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:08,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:08,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:08,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-02-08 00:59:08,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:08,363 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:08,363 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:08,363 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:08,363 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-02-08 00:59:08,363 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:08,363 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:08,363 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:08,363 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-02-08 00:59:08,363 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:08,363 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:08,363 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-02-08 00:59:08,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:08,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:08,363 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:08,363 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-02-08 00:59:08,363 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-02-08 00:59:08,363 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:08,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:08,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:08,464 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:08,464 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:08,464 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:08,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:08,466 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:59:08,467 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): 27ddb7f5c95f0b9f97df2803a621f3c9/family1 is initiating major compaction (all files) 2023-02-08 00:59:08,467 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:59:08,467 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:59:08,468 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of 27ddb7f5c95f0b9f97df2803a621f3c9/family1 in ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:59:08,468 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/a08d10e6b22f4987be840b448c1012ed, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/76bbb166a37242aea47d0b2c476f02db, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/8c13f8717a8442ed978802da0074335a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/63c8412846cb408e9c0b27fe2bc7a85a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/27bb82fc8ac348e4bb290b5a5c9afddf] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp, totalSize=26.6 K 2023-02-08 00:59:08,469 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting a08d10e6b22f4987be840b448c1012ed, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817935685 2023-02-08 00:59:08,470 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 76bbb166a37242aea47d0b2c476f02db, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817938549 2023-02-08 00:59:08,471 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 8c13f8717a8442ed978802da0074335a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817941296 2023-02-08 00:59:08,472 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 63c8412846cb408e9c0b27fe2bc7a85a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817943530 2023-02-08 00:59:08,473 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 27bb82fc8ac348e4bb290b5a5c9afddf, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 00:59:08,482 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): 27ddb7f5c95f0b9f97df2803a621f3c9#family1#compaction#150 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:59:08,903 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302082b48d7bd01e9415584361a62022e5731_del 2023-02-08 00:59:08,903 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302082b48d7bd01e9415584361a62022e5731_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202302082b48d7bd01e9415584361a62022e5731_del 2023-02-08 00:59:09,729 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4dd0e2d0a6c84d64929aaa35798aa1fa 2023-02-08 00:59:09,730 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family1/4dd0e2d0a6c84d64929aaa35798aa1fa as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/4dd0e2d0a6c84d64929aaa35798aa1fa 2023-02-08 00:59:09,736 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4dd0e2d0a6c84d64929aaa35798aa1fa 2023-02-08 00:59:09,737 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 27ddb7f5c95f0b9f97df2803a621f3c9/family1 of 27ddb7f5c95f0b9f97df2803a621f3c9 into 4dd0e2d0a6c84d64929aaa35798aa1fa(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:59:09,737 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for 27ddb7f5c95f0b9f97df2803a621f3c9: 2023-02-08 00:59:09,737 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:59:09,737 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): 27ddb7f5c95f0b9f97df2803a621f3c9/family2 is initiating major compaction (all files) 2023-02-08 00:59:09,737 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:59:09,738 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:59:09,738 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of 27ddb7f5c95f0b9f97df2803a621f3c9/family2 in ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 00:59:09,738 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/d8a719e1e70f4115ba51c0892e5fd1ce, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/cba43e8963b445a788806c10147ed298, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/cd70769f457f4c45badbb63347103882, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/b7050f0ef02b4475b7d5444c67912c97, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/b2c3f7f0602043c4aa9e8d2188284e8c] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp, totalSize=25.3 K 2023-02-08 00:59:09,738 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting d8a719e1e70f4115ba51c0892e5fd1ce, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817935685 2023-02-08 00:59:09,739 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting cba43e8963b445a788806c10147ed298, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817938549 2023-02-08 00:59:09,739 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting cd70769f457f4c45badbb63347103882, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817941296 2023-02-08 00:59:09,740 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting b7050f0ef02b4475b7d5444c67912c97, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817943530 2023-02-08 00:59:09,740 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting b2c3f7f0602043c4aa9e8d2188284e8c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 00:59:09,759 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): 27ddb7f5c95f0b9f97df2803a621f3c9#family2#compaction#151 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:59:09,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/a08d10e6b22f4987be840b448c1012ed, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/76bbb166a37242aea47d0b2c476f02db, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/8c13f8717a8442ed978802da0074335a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/63c8412846cb408e9c0b27fe2bc7a85a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/27bb82fc8ac348e4bb290b5a5c9afddf] to archive 2023-02-08 00:59:09,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:09,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/a08d10e6b22f4987be840b448c1012ed to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/a08d10e6b22f4987be840b448c1012ed 2023-02-08 00:59:09,796 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/76bbb166a37242aea47d0b2c476f02db to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/76bbb166a37242aea47d0b2c476f02db 2023-02-08 00:59:09,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/8c13f8717a8442ed978802da0074335a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/8c13f8717a8442ed978802da0074335a 2023-02-08 00:59:09,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/63c8412846cb408e9c0b27fe2bc7a85a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/63c8412846cb408e9c0b27fe2bc7a85a 2023-02-08 00:59:09,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/27bb82fc8ac348e4bb290b5a5c9afddf to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/27bb82fc8ac348e4bb290b5a5c9afddf 2023-02-08 00:59:10,184 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230208056a7dc26bc944e6926a5e0812e1b4a9_del 2023-02-08 00:59:10,184 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208056a7dc26bc944e6926a5e0812e1b4a9_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20230208056a7dc26bc944e6926a5e0812e1b4a9_del 2023-02-08 00:59:11,007 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ecaaff80356540ed8b12506108e57d47 2023-02-08 00:59:11,009 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/.tmp/family2/ecaaff80356540ed8b12506108e57d47 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/ecaaff80356540ed8b12506108e57d47 2023-02-08 00:59:11,015 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ecaaff80356540ed8b12506108e57d47 2023-02-08 00:59:11,016 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 27ddb7f5c95f0b9f97df2803a621f3c9/family2 of 27ddb7f5c95f0b9f97df2803a621f3c9 into ecaaff80356540ed8b12506108e57d47(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:59:11,017 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for 27ddb7f5c95f0b9f97df2803a621f3c9: 2023-02-08 00:59:11,017 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:59:11,017 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): 2ac42b7db01e98b42cdc33a9b82921f5/family1 is initiating major compaction (all files) 2023-02-08 00:59:11,017 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:59:11,017 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:59:11,017 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of 2ac42b7db01e98b42cdc33a9b82921f5/family1 in ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:59:11,018 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/2164a3ff99e64f97bc1169cf36ec53c7, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/615277c4dacc48ad96b9e670676643ac, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/c33a4cf375f84e5e86e047f20c4fe5d5, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/71ef50c361ba44ac97603bf7ec23cc85, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/783e2bde1df74456857c7df49fa5825f] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp, totalSize=26.6 K 2023-02-08 00:59:11,018 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 2164a3ff99e64f97bc1169cf36ec53c7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817935685 2023-02-08 00:59:11,019 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 615277c4dacc48ad96b9e670676643ac, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817938550 2023-02-08 00:59:11,019 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting c33a4cf375f84e5e86e047f20c4fe5d5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817941296 2023-02-08 00:59:11,019 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 71ef50c361ba44ac97603bf7ec23cc85, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817943530 2023-02-08 00:59:11,020 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 783e2bde1df74456857c7df49fa5825f, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 00:59:11,029 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): 2ac42b7db01e98b42cdc33a9b82921f5#family1#compaction#152 average throughput is 0.83 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:59:11,099 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/d8a719e1e70f4115ba51c0892e5fd1ce, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/cba43e8963b445a788806c10147ed298, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/cd70769f457f4c45badbb63347103882, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/b7050f0ef02b4475b7d5444c67912c97, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/b2c3f7f0602043c4aa9e8d2188284e8c] to archive 2023-02-08 00:59:11,100 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:11,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/d8a719e1e70f4115ba51c0892e5fd1ce to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/d8a719e1e70f4115ba51c0892e5fd1ce 2023-02-08 00:59:11,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/cba43e8963b445a788806c10147ed298 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/cba43e8963b445a788806c10147ed298 2023-02-08 00:59:11,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/cd70769f457f4c45badbb63347103882 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/cd70769f457f4c45badbb63347103882 2023-02-08 00:59:11,111 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/b7050f0ef02b4475b7d5444c67912c97 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/b7050f0ef02b4475b7d5444c67912c97 2023-02-08 00:59:11,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/b2c3f7f0602043c4aa9e8d2188284e8c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family2/b2c3f7f0602043c4aa9e8d2188284e8c 2023-02-08 00:59:11,439 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302083d92cc8dd1ac4372b0093f4f30c6c973_del 2023-02-08 00:59:11,439 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302083d92cc8dd1ac4372b0093f4f30c6c973_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302083d92cc8dd1ac4372b0093f4f30c6c973_del 2023-02-08 00:59:12,260 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc7fff0db8f24a9bb32c40f3587366d2 2023-02-08 00:59:12,262 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family1/dc7fff0db8f24a9bb32c40f3587366d2 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/dc7fff0db8f24a9bb32c40f3587366d2 2023-02-08 00:59:12,267 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc7fff0db8f24a9bb32c40f3587366d2 2023-02-08 00:59:12,268 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2ac42b7db01e98b42cdc33a9b82921f5/family1 of 2ac42b7db01e98b42cdc33a9b82921f5 into dc7fff0db8f24a9bb32c40f3587366d2(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:59:12,268 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for 2ac42b7db01e98b42cdc33a9b82921f5: 2023-02-08 00:59:12,268 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:59:12,268 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): 2ac42b7db01e98b42cdc33a9b82921f5/family2 is initiating major compaction (all files) 2023-02-08 00:59:12,268 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:59:12,268 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:59:12,269 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of 2ac42b7db01e98b42cdc33a9b82921f5/family2 in ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 00:59:12,269 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/c268039cb5a8480f8e2e6f1b2f7f4aba, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/192053737e7542ca8ac88e658f34e4ac, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/a52670338e74470bb10377af3f1ce79f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/e194a1db55a54b519fe67c4afe1691c2, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/bbb0d314a0494a6eafe58d4630365786] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp, totalSize=25.3 K 2023-02-08 00:59:12,269 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting c268039cb5a8480f8e2e6f1b2f7f4aba, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817935685 2023-02-08 00:59:12,270 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 192053737e7542ca8ac88e658f34e4ac, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817938550 2023-02-08 00:59:12,270 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting a52670338e74470bb10377af3f1ce79f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817941296 2023-02-08 00:59:12,271 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting e194a1db55a54b519fe67c4afe1691c2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817943530 2023-02-08 00:59:12,271 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting bbb0d314a0494a6eafe58d4630365786, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 00:59:12,285 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): 2ac42b7db01e98b42cdc33a9b82921f5#family2#compaction#153 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:59:12,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/2164a3ff99e64f97bc1169cf36ec53c7, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/615277c4dacc48ad96b9e670676643ac, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/c33a4cf375f84e5e86e047f20c4fe5d5, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/71ef50c361ba44ac97603bf7ec23cc85, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/783e2bde1df74456857c7df49fa5825f] to archive 2023-02-08 00:59:12,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:12,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/2164a3ff99e64f97bc1169cf36ec53c7 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/2164a3ff99e64f97bc1169cf36ec53c7 2023-02-08 00:59:12,297 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/615277c4dacc48ad96b9e670676643ac to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/615277c4dacc48ad96b9e670676643ac 2023-02-08 00:59:12,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/c33a4cf375f84e5e86e047f20c4fe5d5 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/c33a4cf375f84e5e86e047f20c4fe5d5 2023-02-08 00:59:12,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/71ef50c361ba44ac97603bf7ec23cc85 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/71ef50c361ba44ac97603bf7ec23cc85 2023-02-08 00:59:12,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/783e2bde1df74456857c7df49fa5825f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/783e2bde1df74456857c7df49fa5825f 2023-02-08 00:59:12,693 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020860fb23bf20f040ceaa3af71b1bec9872_del 2023-02-08 00:59:12,693 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020860fb23bf20f040ceaa3af71b1bec9872_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023020860fb23bf20f040ceaa3af71b1bec9872_del 2023-02-08 00:59:13,507 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for efa7558877ed42438ad749919003bdd2 2023-02-08 00:59:13,507 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/.tmp/family2/efa7558877ed42438ad749919003bdd2 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/efa7558877ed42438ad749919003bdd2 2023-02-08 00:59:13,511 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for efa7558877ed42438ad749919003bdd2 2023-02-08 00:59:13,511 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2ac42b7db01e98b42cdc33a9b82921f5/family2 of 2ac42b7db01e98b42cdc33a9b82921f5 into efa7558877ed42438ad749919003bdd2(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:59:13,512 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for 2ac42b7db01e98b42cdc33a9b82921f5: 2023-02-08 00:59:13,512 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:59:13,512 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): a9b1b2d3dd6bede138606a2ea05db424/family1 is initiating major compaction (all files) 2023-02-08 00:59:13,512 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:59:13,512 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:59:13,512 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of a9b1b2d3dd6bede138606a2ea05db424/family1 in ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:59:13,512 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/5556aebc4a194e26ac86d766ab3b3b39, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/d2d96d9620de4b6b9f99cb156d807c0b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/175178ef0eab45179f9581ef3e657fa4, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/b4968cb20e99476db1da00589d9e323c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/b2d5441e609a4badaa23005f2c9c0b5b] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp, totalSize=26.6 K 2023-02-08 00:59:13,513 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 5556aebc4a194e26ac86d766ab3b3b39, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817935684 2023-02-08 00:59:13,513 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting d2d96d9620de4b6b9f99cb156d807c0b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817938549 2023-02-08 00:59:13,513 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 175178ef0eab45179f9581ef3e657fa4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817941296 2023-02-08 00:59:13,514 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting b4968cb20e99476db1da00589d9e323c, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817943529 2023-02-08 00:59:13,514 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting b2d5441e609a4badaa23005f2c9c0b5b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 00:59:13,529 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): a9b1b2d3dd6bede138606a2ea05db424#family1#compaction#154 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:59:13,593 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/c268039cb5a8480f8e2e6f1b2f7f4aba, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/192053737e7542ca8ac88e658f34e4ac, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/a52670338e74470bb10377af3f1ce79f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/e194a1db55a54b519fe67c4afe1691c2, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/bbb0d314a0494a6eafe58d4630365786] to archive 2023-02-08 00:59:13,594 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:13,595 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/c268039cb5a8480f8e2e6f1b2f7f4aba to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/c268039cb5a8480f8e2e6f1b2f7f4aba 2023-02-08 00:59:13,597 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/192053737e7542ca8ac88e658f34e4ac to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/192053737e7542ca8ac88e658f34e4ac 2023-02-08 00:59:13,598 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/a52670338e74470bb10377af3f1ce79f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/a52670338e74470bb10377af3f1ce79f 2023-02-08 00:59:13,599 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/e194a1db55a54b519fe67c4afe1691c2 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/e194a1db55a54b519fe67c4afe1691c2 2023-02-08 00:59:13,600 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/bbb0d314a0494a6eafe58d4630365786 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family2/bbb0d314a0494a6eafe58d4630365786 2023-02-08 00:59:13,947 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230208a6be5ac5300042b9b878780d8a9d2fc7_del 2023-02-08 00:59:13,947 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208a6be5ac5300042b9b878780d8a9d2fc7_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20230208a6be5ac5300042b9b878780d8a9d2fc7_del 2023-02-08 00:59:14,772 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e4497c3d1dd4c03b1810f1f8bc1fcda 2023-02-08 00:59:14,774 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family1/7e4497c3d1dd4c03b1810f1f8bc1fcda as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/7e4497c3d1dd4c03b1810f1f8bc1fcda 2023-02-08 00:59:14,780 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7e4497c3d1dd4c03b1810f1f8bc1fcda 2023-02-08 00:59:14,781 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a9b1b2d3dd6bede138606a2ea05db424/family1 of a9b1b2d3dd6bede138606a2ea05db424 into 7e4497c3d1dd4c03b1810f1f8bc1fcda(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:59:14,781 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for a9b1b2d3dd6bede138606a2ea05db424: 2023-02-08 00:59:14,781 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:59:14,781 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): a9b1b2d3dd6bede138606a2ea05db424/family2 is initiating major compaction (all files) 2023-02-08 00:59:14,781 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:59:14,781 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:59:14,782 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of a9b1b2d3dd6bede138606a2ea05db424/family2 in ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 00:59:14,782 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/d0d372978bd447e18bf613cdfb7e2084, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/83fb2acb7c0e4033beb679c3ac50a085, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/49890bc2d8f246fc850ca4b2d2eaf485, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/0955f765fee34f0ea8211b68e8634a80, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/75496c0c502c4abb82c74ddd05b6c6f6] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp, totalSize=25.3 K 2023-02-08 00:59:14,782 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting d0d372978bd447e18bf613cdfb7e2084, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817935684 2023-02-08 00:59:14,783 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 83fb2acb7c0e4033beb679c3ac50a085, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817938549 2023-02-08 00:59:14,783 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 49890bc2d8f246fc850ca4b2d2eaf485, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817941296 2023-02-08 00:59:14,784 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 0955f765fee34f0ea8211b68e8634a80, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817943529 2023-02-08 00:59:14,784 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 75496c0c502c4abb82c74ddd05b6c6f6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 00:59:14,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/5556aebc4a194e26ac86d766ab3b3b39, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/d2d96d9620de4b6b9f99cb156d807c0b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/175178ef0eab45179f9581ef3e657fa4, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/b4968cb20e99476db1da00589d9e323c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/b2d5441e609a4badaa23005f2c9c0b5b] to archive 2023-02-08 00:59:14,793 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:14,794 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): a9b1b2d3dd6bede138606a2ea05db424#family2#compaction#155 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:59:14,795 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/5556aebc4a194e26ac86d766ab3b3b39 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/5556aebc4a194e26ac86d766ab3b3b39 2023-02-08 00:59:14,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/d2d96d9620de4b6b9f99cb156d807c0b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/d2d96d9620de4b6b9f99cb156d807c0b 2023-02-08 00:59:14,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/175178ef0eab45179f9581ef3e657fa4 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/175178ef0eab45179f9581ef3e657fa4 2023-02-08 00:59:14,799 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/b4968cb20e99476db1da00589d9e323c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/b4968cb20e99476db1da00589d9e323c 2023-02-08 00:59:14,801 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/b2d5441e609a4badaa23005f2c9c0b5b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/b2d5441e609a4badaa23005f2c9c0b5b 2023-02-08 00:59:14,805 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023020810a4e8fab1c8487c8d83d16c61deb80e_del 2023-02-08 00:59:14,805 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020810a4e8fab1c8487c8d83d16c61deb80e_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023020810a4e8fab1c8487c8d83d16c61deb80e_del 2023-02-08 00:59:15,625 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f862d76d29c94a1d90c2350308a86c41 2023-02-08 00:59:15,627 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/.tmp/family2/f862d76d29c94a1d90c2350308a86c41 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/f862d76d29c94a1d90c2350308a86c41 2023-02-08 00:59:15,632 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f862d76d29c94a1d90c2350308a86c41 2023-02-08 00:59:15,633 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a9b1b2d3dd6bede138606a2ea05db424/family2 of a9b1b2d3dd6bede138606a2ea05db424 into f862d76d29c94a1d90c2350308a86c41(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:59:15,633 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for a9b1b2d3dd6bede138606a2ea05db424: 2023-02-08 00:59:15,636 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:59:15,639 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:59:15,642 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:59:15,642 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:59:15,648 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-08 00:59:15,658 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-02-08 00:59:15,661 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230208a6be5ac5300042b9b878780d8a9d2fc7_del 2023-02-08 00:59:15,664 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202302082b48d7bd01e9415584361a62022e5731_del 2023-02-08 00:59:15,667 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202302083d92cc8dd1ac4372b0093f4f30c6c973_del 2023-02-08 00:59:15,667 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-02-08 00:59:15,667 DEBUG [Listener at localhost.localdomain/36213] zookeeper.ReadOnlyZKClient(139): Connect 0x4576ae8d to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:59:15,693 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/d0d372978bd447e18bf613cdfb7e2084, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/83fb2acb7c0e4033beb679c3ac50a085, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/49890bc2d8f246fc850ca4b2d2eaf485, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/0955f765fee34f0ea8211b68e8634a80, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/75496c0c502c4abb82c74ddd05b6c6f6] to archive 2023-02-08 00:59:15,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:15,695 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/d0d372978bd447e18bf613cdfb7e2084 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/d0d372978bd447e18bf613cdfb7e2084 2023-02-08 00:59:15,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/83fb2acb7c0e4033beb679c3ac50a085 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/83fb2acb7c0e4033beb679c3ac50a085 2023-02-08 00:59:15,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/49890bc2d8f246fc850ca4b2d2eaf485 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/49890bc2d8f246fc850ca4b2d2eaf485 2023-02-08 00:59:15,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/0955f765fee34f0ea8211b68e8634a80 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/0955f765fee34f0ea8211b68e8634a80 2023-02-08 00:59:15,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/75496c0c502c4abb82c74ddd05b6c6f6 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family2/75496c0c502c4abb82c74ddd05b6c6f6 2023-02-08 00:59:15,986 DEBUG [Listener at localhost.localdomain/36213] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46f912ac, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:59:15,988 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230208 for table='ns:testMinorCompaction' and column='family1' 2023-02-08 00:59:15,988 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230208 for table='ns:testMinorCompaction' and column='family1' 2023-02-08 00:59:15,988 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230208 for table='ns:testMinorCompaction' and column='family1' 2023-02-08 00:59:16,430 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208faea9e482a754f6bb58fe572c14598d0 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230208faea9e482a754f6bb58fe572c14598d0 2023-02-08 00:59:16,431 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='ns:testMinorCompaction' column='family1' 2023-02-08 00:59:16,435 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020860d6753fe9dd44289126c4e10cda58d8 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023020860d6753fe9dd44289126c4e10cda58d8 2023-02-08 00:59:16,436 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='ns:testMinorCompaction' column='family1' 2023-02-08 00:59:16,443 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:59:16,445 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:46846, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:59:16,454 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:16,454 INFO [MobFileCompactionChore-pool-0] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:16,454 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:59:16,458 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:52224, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:59:16,460 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:16,460 INFO [MobFileCompactionChore-pool-2] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:16,471 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230208/family1/af1678080a894c7e8e84e8640e36ef81 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-02-08 00:59:16,472 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230208/family1/af1678080a894c7e8e84e8640e36ef81}] 2023-02-08 00:59:16,474 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/family1/53df9c7f36b447e9bbd8c7fef0e2e658 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-02-08 00:59:16,475 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/family1/53df9c7f36b447e9bbd8c7fef0e2e658}] 2023-02-08 00:59:16,477 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/family1/53df9c7f36b447e9bbd8c7fef0e2e658 for inclusion in a9b1b2d3dd6bede138606a2ea05db424/family1 2023-02-08 00:59:16,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230208/family1/af1678080a894c7e8e84e8640e36ef81 for inclusion in 27ddb7f5c95f0b9f97df2803a621f3c9/family1 2023-02-08 00:59:16,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-02-08 00:59:16,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-08 00:59:16,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-02-08 00:59:16,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last=1 2023-02-08 00:59:16,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 27ddb7f5c95f0b9f97df2803a621f3c9: 2023-02-08 00:59:16,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for a9b1b2d3dd6bede138606a2ea05db424: 2023-02-08 00:59:16,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230208/family1/af1678080a894c7e8e84e8640e36ef81 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__gk7se2idftchhhne7hfhg858laeo0u8hatl3oorc9bv4ceic83u4l8ppmrfss1eg/family1/af1678080a894c7e8e84e8640e36ef81 2023-02-08 00:59:16,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230208/family1/53df9c7f36b447e9bbd8c7fef0e2e658 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__q2j4liacqgs5b3ni8upeb8eaa86tl1brdb2dqmec88l6n328c0k9kl5gs231fgbo/family1/53df9c7f36b447e9bbd8c7fef0e2e658 2023-02-08 00:59:16,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__gk7se2idftchhhne7hfhg858laeo0u8hatl3oorc9bv4ceic83u4l8ppmrfss1eg/family1/af1678080a894c7e8e84e8640e36ef81 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/6e52c856e1674a4f918a06789ab2c538_SeqId_28_ 2023-02-08 00:59:16,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__q2j4liacqgs5b3ni8upeb8eaa86tl1brdb2dqmec88l6n328c0k9kl5gs231fgbo/family1/53df9c7f36b447e9bbd8c7fef0e2e658 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/cef4e3dbc8664808aa8b3d34c2c5716b_SeqId_28_ 2023-02-08 00:59:16,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__gk7se2idftchhhne7hfhg858laeo0u8hatl3oorc9bv4ceic83u4l8ppmrfss1eg/family1/af1678080a894c7e8e84e8640e36ef81 into 27ddb7f5c95f0b9f97df2803a621f3c9/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/6e52c856e1674a4f918a06789ab2c538_SeqId_28_ - updating store file list. 2023-02-08 00:59:16,482 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__q2j4liacqgs5b3ni8upeb8eaa86tl1brdb2dqmec88l6n328c0k9kl5gs231fgbo/family1/53df9c7f36b447e9bbd8c7fef0e2e658 into a9b1b2d3dd6bede138606a2ea05db424/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/cef4e3dbc8664808aa8b3d34c2c5716b_SeqId_28_ - updating store file list. 2023-02-08 00:59:16,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/6e52c856e1674a4f918a06789ab2c538_SeqId_28_ into 27ddb7f5c95f0b9f97df2803a621f3c9/family1 2023-02-08 00:59:16,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/cef4e3dbc8664808aa8b3d34c2c5716b_SeqId_28_ into a9b1b2d3dd6bede138606a2ea05db424/family1 2023-02-08 00:59:16,485 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__gk7se2idftchhhne7hfhg858laeo0u8hatl3oorc9bv4ceic83u4l8ppmrfss1eg/family1/af1678080a894c7e8e84e8640e36ef81 into 27ddb7f5c95f0b9f97df2803a621f3c9/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/family1/6e52c856e1674a4f918a06789ab2c538_SeqId_28_) 2023-02-08 00:59:16,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__q2j4liacqgs5b3ni8upeb8eaa86tl1brdb2dqmec88l6n328c0k9kl5gs231fgbo/family1/53df9c7f36b447e9bbd8c7fef0e2e658 into a9b1b2d3dd6bede138606a2ea05db424/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/family1/cef4e3dbc8664808aa8b3d34c2c5716b_SeqId_28_) 2023-02-08 00:59:16,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__gk7se2idftchhhne7hfhg858laeo0u8hatl3oorc9bv4ceic83u4l8ppmrfss1eg/family1/af1678080a894c7e8e84e8640e36ef81 2023-02-08 00:59:16,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__q2j4liacqgs5b3ni8upeb8eaa86tl1brdb2dqmec88l6n328c0k9kl5gs231fgbo/family1/53df9c7f36b447e9bbd8c7fef0e2e658 2023-02-08 00:59:16,487 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='ns:testMinorCompaction' column='family1' 2023-02-08 00:59:16,487 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='ns:testMinorCompaction' column='family1' 2023-02-08 00:59:16,488 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:16,488 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:16,489 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230208385b1b1d32de419f8069d299bb3724d9 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20230208385b1b1d32de419f8069d299bb3724d9 2023-02-08 00:59:16,489 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-08 00:59:16,489 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302087176d932ae544ca38b34263ff84898c4 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202302087176d932ae544ca38b34263ff84898c4 2023-02-08 00:59:16,489 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20230208' 2023-02-08 00:59:16,489 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-08 00:59:16,489 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20230208' 2023-02-08 00:59:16,489 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230208 for table='ns:testMinorCompaction' and column='family1' 2023-02-08 00:59:16,489 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230208 for table='ns:testMinorCompaction' and column='family1' 2023-02-08 00:59:16,824 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302085afdffb1bf6c40c49d81527d8ddfedde to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202302085afdffb1bf6c40c49d81527d8ddfedde 2023-02-08 00:59:16,825 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='ns:testMinorCompaction' column='family1' 2023-02-08 00:59:16,840 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:16,840 INFO [MobFileCompactionChore-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:16,848 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230208/family1/cd85efc4814d4dcd86b831998fdd3862 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-02-08 00:59:16,849 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230208/family1/cd85efc4814d4dcd86b831998fdd3862}] 2023-02-08 00:59:16,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230208/family1/cd85efc4814d4dcd86b831998fdd3862 for inclusion in 2ac42b7db01e98b42cdc33a9b82921f5/family1 2023-02-08 00:59:16,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-02-08 00:59:16,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-08 00:59:16,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 2ac42b7db01e98b42cdc33a9b82921f5: 2023-02-08 00:59:16,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230208/family1/cd85efc4814d4dcd86b831998fdd3862 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__vv2mo6h7d9aj7q9djhs8au7fe62bh8msn7t7g9djk36soeja8mur9o198bhd2p09/family1/cd85efc4814d4dcd86b831998fdd3862 2023-02-08 00:59:16,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__vv2mo6h7d9aj7q9djhs8au7fe62bh8msn7t7g9djk36soeja8mur9o198bhd2p09/family1/cd85efc4814d4dcd86b831998fdd3862 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/0678f0ef11544b638a8fc5ddb6efd9cd_SeqId_28_ 2023-02-08 00:59:16,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__vv2mo6h7d9aj7q9djhs8au7fe62bh8msn7t7g9djk36soeja8mur9o198bhd2p09/family1/cd85efc4814d4dcd86b831998fdd3862 into 2ac42b7db01e98b42cdc33a9b82921f5/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/0678f0ef11544b638a8fc5ddb6efd9cd_SeqId_28_ - updating store file list. 2023-02-08 00:59:16,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/0678f0ef11544b638a8fc5ddb6efd9cd_SeqId_28_ into 2ac42b7db01e98b42cdc33a9b82921f5/family1 2023-02-08 00:59:16,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__vv2mo6h7d9aj7q9djhs8au7fe62bh8msn7t7g9djk36soeja8mur9o198bhd2p09/family1/cd85efc4814d4dcd86b831998fdd3862 into 2ac42b7db01e98b42cdc33a9b82921f5/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/family1/0678f0ef11544b638a8fc5ddb6efd9cd_SeqId_28_) 2023-02-08 00:59:16,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__ns_testMinorCompaction__vv2mo6h7d9aj7q9djhs8au7fe62bh8msn7t7g9djk36soeja8mur9o198bhd2p09/family1/cd85efc4814d4dcd86b831998fdd3862 2023-02-08 00:59:16,859 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='ns:testMinorCompaction' column='family1' 2023-02-08 00:59:16,860 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:16,861 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230208fd75a99ed756478696dc6538e002dfdc to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20230208fd75a99ed756478696dc6538e002dfdc 2023-02-08 00:59:16,861 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-02-08 00:59:16,861 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20230208' 2023-02-08 00:59:16,861 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230208 for table='ns:testMinorCompaction' and column='family1' 2023-02-08 00:59:16,861 INFO [Listener at localhost.localdomain/36213] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-02-08 00:59:16,864 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:59:16,866 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:59:16,869 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:59:16,869 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:59:16,884 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=243 (was 276), OpenFileDescriptor=599 (was 725), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=322 (was 311) - SystemLoadAverage LEAK? -, ProcessCount=175 (was 175), AvailableMemoryMB=3983 (was 3246) - AvailableMemoryMB LEAK? - 2023-02-08 00:59:16,895 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=243, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=322, ProcessCount=175, AvailableMemoryMB=3982 2023-02-08 00:59:16,895 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:16,897 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:16,898 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-02-08 00:59:16,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:16,900 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 00:59:16,900 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-02-08 00:59:16,901 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:16,901 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:16,901 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 00:59:16,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-08 00:59:16,902 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c 2023-02-08 00:59:16,902 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c empty. 2023-02-08 00:59:16,902 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c 2023-02-08 00:59:16,903 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-02-08 00:59:17,002 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:17,002 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:17,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-08 00:59:17,203 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:17,203 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:17,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-08 00:59:17,311 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-02-08 00:59:17,312 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7671): creating {ENCODED => cf587d948e645a697b6b2e156bc5c00c, NAME => 'testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:59:17,504 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:17,504 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:17,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-08 00:59:17,717 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:59:17,717 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1603): Closing cf587d948e645a697b6b2e156bc5c00c, disabling compactions & flushes 2023-02-08 00:59:17,717 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:17,717 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:17,717 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. after waiting 0 ms 2023-02-08 00:59:17,717 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:17,717 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:17,717 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1557): Region close journal for cf587d948e645a697b6b2e156bc5c00c: Waiting for close lock at 1675817957717Disabling compacts and flushes for region at 1675817957717Disabling writes for close at 1675817957717Writing region close event to WAL at 1675817957717Closed at 1675817957717 2023-02-08 00:59:17,719 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 00:59:17,720 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675817957720"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817957720"}]},"ts":"1675817957720"} 2023-02-08 00:59:17,721 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-02-08 00:59:17,722 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 00:59:17,722 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817957722"}]},"ts":"1675817957722"} 2023-02-08 00:59:17,723 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-02-08 00:59:18,005 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:18,005 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:18,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-08 00:59:18,012 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=cf587d948e645a697b6b2e156bc5c00c, ASSIGN}] 2023-02-08 00:59:18,015 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=cf587d948e645a697b6b2e156bc5c00c, ASSIGN 2023-02-08 00:59:18,017 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=cf587d948e645a697b6b2e156bc5c00c, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:59:18,168 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=cf587d948e645a697b6b2e156bc5c00c, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:18,168 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675817958168"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817958168"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817958168"}]},"ts":"1675817958168"} 2023-02-08 00:59:18,170 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure cf587d948e645a697b6b2e156bc5c00c, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:59:18,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:18,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => cf587d948e645a697b6b2e156bc5c00c, NAME => 'testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c.', STARTKEY => '', ENDKEY => ''} 2023-02-08 00:59:18,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy cf587d948e645a697b6b2e156bc5c00c 2023-02-08 00:59:18,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:59:18,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for cf587d948e645a697b6b2e156bc5c00c 2023-02-08 00:59:18,330 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for cf587d948e645a697b6b2e156bc5c00c 2023-02-08 00:59:18,332 INFO [StoreOpener-cf587d948e645a697b6b2e156bc5c00c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region cf587d948e645a697b6b2e156bc5c00c 2023-02-08 00:59:18,335 DEBUG [StoreOpener-cf587d948e645a697b6b2e156bc5c00c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1 2023-02-08 00:59:18,335 DEBUG [StoreOpener-cf587d948e645a697b6b2e156bc5c00c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1 2023-02-08 00:59:18,336 INFO [StoreOpener-cf587d948e645a697b6b2e156bc5c00c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf587d948e645a697b6b2e156bc5c00c columnFamilyName family1 2023-02-08 00:59:18,338 INFO [StoreOpener-cf587d948e645a697b6b2e156bc5c00c-1] regionserver.HStore(310): Store=cf587d948e645a697b6b2e156bc5c00c/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:59:18,339 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c 2023-02-08 00:59:18,340 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c 2023-02-08 00:59:18,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for cf587d948e645a697b6b2e156bc5c00c 2023-02-08 00:59:18,346 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:59:18,347 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened cf587d948e645a697b6b2e156bc5c00c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73322588, jitterRate=0.09259170293807983}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-02-08 00:59:18,347 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for cf587d948e645a697b6b2e156bc5c00c: Running coprocessor pre-open hook at 1675817958330Writing region info on filesystem at 1675817958330Initializing all the Stores at 1675817958332 (+2 ms)Instantiating store for column family {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} at 1675817958332Cleaning up temporary data from old regions at 1675817958340 (+8 ms)Cleaning up detritus from prior splits at 1675817958341 (+1 ms)Running coprocessor post-open hooks at 1675817958347 (+6 ms)Region opened successfully at 1675817958347 2023-02-08 00:59:18,348 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c., pid=114, masterSystemTime=1675817958323 2023-02-08 00:59:18,350 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:18,350 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:18,350 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=cf587d948e645a697b6b2e156bc5c00c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:18,350 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1675817958350"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817958350"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817958350"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817958350"}]},"ts":"1675817958350"} 2023-02-08 00:59:18,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=114, resume processing ppid=113 2023-02-08 00:59:18,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure cf587d948e645a697b6b2e156bc5c00c, server=jenkins-hbase12.apache.org,36907,1675817727419 in 182 msec 2023-02-08 00:59:18,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=113, resume processing ppid=112 2023-02-08 00:59:18,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=cf587d948e645a697b6b2e156bc5c00c, ASSIGN in 343 msec 2023-02-08 00:59:18,358 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 00:59:18,359 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817958359"}]},"ts":"1675817958359"} 2023-02-08 00:59:18,360 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-02-08 00:59:18,471 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 00:59:18,474 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.5730 sec 2023-02-08 00:59:19,007 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:19,008 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:19,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=112 2023-02-08 00:59:19,010 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-02-08 00:59:19,032 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:19,033 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:19,033 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:19,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:19,034 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:19,035 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:19,035 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:59:19,035 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:59:19,035 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:19,035 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:19,092 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:19,092 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:19,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:19,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:19,092 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:19,092 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:19,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:19,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:19,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:19,093 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:19,093 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:19,093 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:59:19,094 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:19,094 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:59:19,094 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:59:19,094 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:19,094 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:19,094 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. started... 2023-02-08 00:59:19,095 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cf587d948e645a697b6b2e156bc5c00c 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-02-08 00:59:19,616 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306d6b324c6a4a4770a60a6e1d693cc521 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511306d6b324c6a4a4770a60a6e1d693cc521 2023-02-08 00:59:19,926 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:20,021 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/3500cbca0e8e4628bd8bbbaf7c771037 2023-02-08 00:59:20,033 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/3500cbca0e8e4628bd8bbbaf7c771037 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/3500cbca0e8e4628bd8bbbaf7c771037 2023-02-08 00:59:20,040 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/3500cbca0e8e4628bd8bbbaf7c771037, entries=1000, sequenceid=5, filesize=166.0 K 2023-02-08 00:59:20,041 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for cf587d948e645a697b6b2e156bc5c00c in 946ms, sequenceid=5, compaction requested=false 2023-02-08 00:59:20,041 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:20,041 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:20,042 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:59:20,042 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:59:20,042 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,042 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:59:20,042 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:59:20,146 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,146 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:20,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:20,147 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,148 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:20,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:20,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:20,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:59:20,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f50043e[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:20,153 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:59:20,153 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,218 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,218 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:59:20,218 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:59:20,218 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,218 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:20,218 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:20,259 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,259 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:59:20,259 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:20,259 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:59:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:20,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:20,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:20,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:20,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:59:20,265 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:59:20,265 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:20,265 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:20,265 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,265 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:20,566 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,566 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,566 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:20,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:20,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:20,567 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:20,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:20,568 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:20,568 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:20,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,571 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:20,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,641 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:20,641 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:20,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:20,641 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,642 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:20,642 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:59:20,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:20,642 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:20,642 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:20,642 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,642 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,643 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:20,643 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,643 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:20,643 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:20,643 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,643 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:20,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:20,643 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,743 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:20,743 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:20,743 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:20,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:20,747 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:20,747 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:20,747 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:20,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:20,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,749 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:20,749 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:20,749 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:59:20,749 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:59:20,749 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:20,749 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,070 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:21,070 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:21,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:21,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:21,070 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:21,071 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:21,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,071 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:21,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,072 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,073 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:59:21,073 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:59:21,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:21,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:59:21,074 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:59:21,074 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:21,074 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:21,074 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. started... 2023-02-08 00:59:21,074 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cf587d948e645a697b6b2e156bc5c00c 1/1 column families, dataSize=74 B heapSize=408 B 2023-02-08 00:59:21,090 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128a3bcec7ec3a24b6d93292b249485b351 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128a3bcec7ec3a24b6d93292b249485b351 2023-02-08 00:59:21,495 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/a267db27d650408eb42feb15715b389b 2023-02-08 00:59:21,499 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/a267db27d650408eb42feb15715b389b as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/a267db27d650408eb42feb15715b389b 2023-02-08 00:59:21,503 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/a267db27d650408eb42feb15715b389b, entries=1, sequenceid=9, filesize=5.0 K 2023-02-08 00:59:21,503 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for cf587d948e645a697b6b2e156bc5c00c in 429ms, sequenceid=9, compaction requested=false 2023-02-08 00:59:21,503 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:21,504 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:21,504 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:59:21,504 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:59:21,504 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:21,504 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:59:21,504 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:59:21,795 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,795 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:21,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:21,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:21,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:21,795 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,795 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:21,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:21,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:21,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:21,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:21,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:59:21,796 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fe4b00a[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:21,796 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:59:21,796 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,851 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,851 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,852 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:59:21,852 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:59:21,852 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:21,852 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:21,852 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:21,870 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:21,870 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:59:21,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:21,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:21,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:21,870 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:21,870 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:59:21,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:21,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:21,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:21,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:21,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:21,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:21,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:59:21,872 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:59:21,872 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:21,872 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:21,872 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,873 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:21,891 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,891 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:21,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:21,891 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:21,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:21,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:21,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:21,891 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,892 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:21,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:21,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:21,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:21,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:22,237 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:22,237 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:22,237 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:22,237 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:22,237 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:22,237 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:22,237 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:22,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:22,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:22,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:59:22,237 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:22,237 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:22,237 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:22,238 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:22,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:22,238 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:22,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:22,238 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:22,238 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:22,338 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:22,338 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:22,338 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:22,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:22,341 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:22,341 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:22,343 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:22,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:22,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:22,345 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:22,345 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:22,345 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:59:22,345 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:59:22,345 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:22,345 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:22,659 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:22,659 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:22,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:22,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:22,660 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:22,660 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:22,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:22,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:22,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:22,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:22,663 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:22,664 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:59:22,664 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:22,664 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:59:22,664 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:22,664 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:59:22,665 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:59:22,665 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:22,665 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:22,665 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. started... 2023-02-08 00:59:22,665 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cf587d948e645a697b6b2e156bc5c00c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:59:23,099 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512018f439dd40b7348fbb4103080b0047625 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512018f439dd40b7348fbb4103080b0047625 2023-02-08 00:59:23,506 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/b09bbff2e2b04d14bc527047c708ff11 2023-02-08 00:59:23,515 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/b09bbff2e2b04d14bc527047c708ff11 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/b09bbff2e2b04d14bc527047c708ff11 2023-02-08 00:59:23,519 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/b09bbff2e2b04d14bc527047c708ff11, entries=1, sequenceid=13, filesize=4.9 K 2023-02-08 00:59:23,519 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf587d948e645a697b6b2e156bc5c00c in 854ms, sequenceid=13, compaction requested=true 2023-02-08 00:59:23,520 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:23,520 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:23,520 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:59:23,520 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:59:23,520 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:23,520 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:59:23,520 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:59:23,691 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:23,691 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:23,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:23,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:23,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:23,692 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:23,693 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:23,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:23,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:23,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:23,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:23,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:23,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:59:23,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75bb44b1[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:23,697 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:59:23,697 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:23,773 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:23,773 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:23,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:23,773 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:59:23,773 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:59:23,774 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:23,774 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:23,774 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:23,785 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:59:23,785 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:23,785 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:23,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:23,786 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:59:23,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:23,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:23,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:23,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:23,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:23,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:23,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:23,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:23,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:23,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:23,789 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:59:23,789 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:59:23,789 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:23,789 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:23,789 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:23,789 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:23,866 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:59:24,122 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,122 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,123 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:24,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:24,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:24,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:24,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:24,124 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:24,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:24,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:24,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,128 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:24,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:24,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:24,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:24,153 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:24,153 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:24,153 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:24,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:59:24,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:24,154 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:24,154 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:24,154 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:24,153 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,154 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:24,154 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:24,154 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,154 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,154 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,154 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:24,154 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:24,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:24,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:24,254 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:24,255 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:24,255 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:24,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:24,261 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:24,261 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:24,262 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:24,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:24,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,265 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:24,265 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:24,265 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:59:24,266 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:59:24,266 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,266 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,535 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:24,535 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:24,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:24,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:24,536 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:24,536 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:24,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,536 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:24,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,537 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,538 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:59:24,538 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:24,538 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:59:24,538 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:24,538 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:59:24,538 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:59:24,538 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:24,538 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:24,539 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. started... 2023-02-08 00:59:24,539 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cf587d948e645a697b6b2e156bc5c00c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:59:24,960 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205bf705ce8031d4d8b925a892d776e74f7 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205bf705ce8031d4d8b925a892d776e74f7 2023-02-08 00:59:25,366 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/1739ce5e01184ed7ba326dcce2d9bc27 2023-02-08 00:59:25,370 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/1739ce5e01184ed7ba326dcce2d9bc27 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/1739ce5e01184ed7ba326dcce2d9bc27 2023-02-08 00:59:25,372 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/1739ce5e01184ed7ba326dcce2d9bc27, entries=1, sequenceid=17, filesize=4.9 K 2023-02-08 00:59:25,373 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf587d948e645a697b6b2e156bc5c00c in 834ms, sequenceid=17, compaction requested=true 2023-02-08 00:59:25,373 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:25,373 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:25,373 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:59:25,373 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:59:25,373 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:25,373 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:59:25,373 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:59:25,543 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:25,543 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:25,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:25,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:25,544 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,544 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:25,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:25,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:25,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:25,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:25,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:59:25,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19755369[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:25,547 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:59:25,547 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,564 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,564 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,565 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:59:25,565 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:59:25,565 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:25,565 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:25,565 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:25,835 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:25,835 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:59:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:25,835 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:25,835 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:59:25,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:25,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:25,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:25,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:25,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:25,837 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:25,837 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:59:25,837 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:59:25,837 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:25,837 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:25,837 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,837 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:25,859 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,859 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:25,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:25,859 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:25,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:25,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:25,860 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:25,860 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:25,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:25,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:26,143 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:26,143 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,143 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,143 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:26,143 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,143 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,143 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,143 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:26,143 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:26,143 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:26,143 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:26,143 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:59:26,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:26,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:26,143 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:26,143 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:26,144 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:26,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:26,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:26,244 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:26,244 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:26,244 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:26,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:26,247 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:26,247 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:26,248 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:26,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:26,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,249 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:26,249 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:26,249 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:59:26,249 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:59:26,250 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,250 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,278 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:26,278 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:26,278 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:26,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:26,279 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:26,279 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:26,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,279 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:26,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,280 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,280 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:59:26,280 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,280 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:59:26,280 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:26,280 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:59:26,280 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:59:26,280 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:26,280 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:26,280 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. started... 2023-02-08 00:59:26,280 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cf587d948e645a697b6b2e156bc5c00c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:59:26,699 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228155c90d97bb54f3fafcdf8615fd99590 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228155c90d97bb54f3fafcdf8615fd99590 2023-02-08 00:59:26,706 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/365dbaef8caa4c3fa638e07cc1e1fb02 2023-02-08 00:59:26,711 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/365dbaef8caa4c3fa638e07cc1e1fb02 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/365dbaef8caa4c3fa638e07cc1e1fb02 2023-02-08 00:59:26,716 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/365dbaef8caa4c3fa638e07cc1e1fb02, entries=1, sequenceid=21, filesize=4.9 K 2023-02-08 00:59:26,717 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf587d948e645a697b6b2e156bc5c00c in 437ms, sequenceid=21, compaction requested=true 2023-02-08 00:59:26,718 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:26,718 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:26,718 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:59:26,718 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:59:26,718 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:26,718 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:59:26,718 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:59:26,916 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:26,916 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:26,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:26,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:26,917 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,917 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:26,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:26,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:26,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:26,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:26,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:59:26,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76ebc58d[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:26,922 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:59:26,923 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,988 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:26,989 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:59:26,989 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:59:26,989 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:26,989 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:26,989 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:27,006 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:59:27,006 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:27,006 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:27,006 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:59:27,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:27,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:27,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:27,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:27,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:27,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:27,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:27,013 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:59:27,013 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:59:27,013 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:27,013 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:27,013 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,013 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:27,181 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,181 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:27,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,182 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:27,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:27,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:27,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:27,184 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:27,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:27,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:27,187 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:27,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:27,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:27,484 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:27,484 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:27,484 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,485 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,485 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:27,485 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,485 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,485 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:27,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:27,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:27,485 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:27,485 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:27,486 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:27,485 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,487 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:27,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:27,487 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:27,487 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:27,588 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:27,588 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:27,588 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:27,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:27,591 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:27,591 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:27,592 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:27,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:27,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,593 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:27,593 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:27,593 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:59:27,593 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:59:27,594 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,594 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,904 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:27,904 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:27,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:27,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:27,905 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:27,905 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:27,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,906 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,906 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:59:27,906 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:27,906 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:59:27,906 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:27,906 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:59:27,906 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:59:27,906 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:27,906 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:27,906 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. started... 2023-02-08 00:59:27,906 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cf587d948e645a697b6b2e156bc5c00c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:59:28,318 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512314068cdcaa8ea4ba18d234e06a5485bfb to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512314068cdcaa8ea4ba18d234e06a5485bfb 2023-02-08 00:59:28,725 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/8a31e31f282a4d6c8962126fbe8b80c1 2023-02-08 00:59:28,730 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/8a31e31f282a4d6c8962126fbe8b80c1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/8a31e31f282a4d6c8962126fbe8b80c1 2023-02-08 00:59:28,735 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/8a31e31f282a4d6c8962126fbe8b80c1, entries=1, sequenceid=25, filesize=4.9 K 2023-02-08 00:59:28,736 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf587d948e645a697b6b2e156bc5c00c in 830ms, sequenceid=25, compaction requested=true 2023-02-08 00:59:28,736 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:28,736 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:28,736 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:59:28,736 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:59:28,736 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:28,736 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:59:28,736 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:59:29,036 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,036 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:29,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:29,037 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,037 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:29,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:29,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:29,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:29,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:59:29,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1ce54fba[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:29,041 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:59:29,041 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,135 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,135 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,135 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:29,135 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:59:29,135 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:59:29,135 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:29,146 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:59:29,146 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,146 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:29,146 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:59:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:29,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:29,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:29,148 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:59:29,148 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:59:29,148 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:29,148 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:29,148 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,148 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:29,242 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,242 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,242 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:29,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:29,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:29,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:29,243 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:29,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:29,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:29,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,244 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:29,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,504 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,504 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:29,504 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:29,504 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:59:29,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:29,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:29,504 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:29,505 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:29,504 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:29,504 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,505 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,505 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:29,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:29,505 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,505 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:29,505 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:29,505 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,505 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,605 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:29,605 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:29,606 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:29,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:29,608 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:29,609 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:29,609 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:29,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:29,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,613 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:29,613 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:29,613 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:59:29,613 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:59:29,613 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,613 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,932 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:29,932 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:29,933 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:29,933 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:29,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,934 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,934 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:59:29,934 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:29,934 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:59:29,934 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:29,934 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:59:29,934 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:59:29,934 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:29,934 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:29,934 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. started... 2023-02-08 00:59:29,935 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cf587d948e645a697b6b2e156bc5c00c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:59:30,351 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010148c4898243c44ed295c03f01f418bfcb to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010148c4898243c44ed295c03f01f418bfcb 2023-02-08 00:59:30,760 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/505ff6ea13ed4d49b98be9c7eb2c7dd5 2023-02-08 00:59:30,770 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/505ff6ea13ed4d49b98be9c7eb2c7dd5 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/505ff6ea13ed4d49b98be9c7eb2c7dd5 2023-02-08 00:59:30,775 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/505ff6ea13ed4d49b98be9c7eb2c7dd5, entries=1, sequenceid=29, filesize=4.9 K 2023-02-08 00:59:30,776 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf587d948e645a697b6b2e156bc5c00c in 841ms, sequenceid=29, compaction requested=true 2023-02-08 00:59:30,776 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:30,776 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:30,776 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:59:30,776 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:59:30,776 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:30,776 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:59:30,776 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:59:31,061 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,061 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:31,062 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,062 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:31,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:31,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:59:31,064 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33d41e5b[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:31,064 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:59:31,064 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,073 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:59:31,073 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,073 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:31,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:59:31,073 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:31,082 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:59:31,082 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,082 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:31,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:31,083 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:59:31,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:31,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:31,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:31,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:31,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:59:31,086 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:59:31,086 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:31,086 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:31,086 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,086 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:31,103 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,103 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:31,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:31,104 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:31,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:31,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:31,104 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:31,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:31,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,106 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:31,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,403 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,403 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,403 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:31,403 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:31,404 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:31,404 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:31,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:59:31,404 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:31,404 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:31,403 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,405 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,405 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,403 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:31,405 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,405 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:31,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:31,406 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:31,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:31,505 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:31,505 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:31,505 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:31,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:31,510 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:31,510 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:31,510 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:31,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:31,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,512 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:31,512 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:31,512 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:59:31,512 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:59:31,513 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,513 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,810 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:31,810 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,810 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:31,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:31,810 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:31,810 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:31,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:31,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,811 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,811 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:59:31,811 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:31,811 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:59:31,811 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:31,812 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:59:31,812 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:59:31,812 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:31,812 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:31,812 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. started... 2023-02-08 00:59:31,812 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cf587d948e645a697b6b2e156bc5c00c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:59:32,234 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037ebee313787343f58d445231d45b6076 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601037ebee313787343f58d445231d45b6076 2023-02-08 00:59:32,240 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/e72d1fcf6f7c4845a5e3cfa6ffeb7497 2023-02-08 00:59:32,243 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/e72d1fcf6f7c4845a5e3cfa6ffeb7497 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/e72d1fcf6f7c4845a5e3cfa6ffeb7497 2023-02-08 00:59:32,246 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/e72d1fcf6f7c4845a5e3cfa6ffeb7497, entries=1, sequenceid=33, filesize=4.9 K 2023-02-08 00:59:32,246 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf587d948e645a697b6b2e156bc5c00c in 434ms, sequenceid=33, compaction requested=true 2023-02-08 00:59:32,247 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:32,247 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:32,247 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:59:32,247 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:59:32,247 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,247 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:59:32,247 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:59:32,265 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,265 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:32,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:32,266 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,266 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:32,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:32,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:32,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:59:32,268 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@9fd53[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:32,268 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:59:32,268 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,573 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,573 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,573 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:59:32,573 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:59:32,573 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:32,573 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,573 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:32,732 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:59:32,732 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:32,732 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,732 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:59:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:32,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:32,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:32,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:59:32,735 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:59:32,735 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:32,735 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:32,735 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,735 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:32,798 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,798 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:32,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:32,799 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,799 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:32,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:32,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:32,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:32,800 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:32,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,802 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:32,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,830 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:32,830 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:32,830 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:32,830 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:32,830 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,830 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:32,831 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:32,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:32,831 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:32,831 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:32,831 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,831 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:32,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:32,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:32,831 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,832 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,932 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:32,932 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:32,932 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:32,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:32,942 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:32,942 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:32,944 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:32,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:32,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,946 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:32,946 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:32,946 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:59:32,946 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:59:32,947 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:32,947 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:33,131 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:33,131 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:33,131 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:33,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:33,132 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:33,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:33,132 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:33,133 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:33,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:33,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:33,134 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:33,135 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:59:33,135 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:33,135 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:59:33,135 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:33,135 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:59:33,135 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:59:33,135 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:33,135 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:33,136 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. started... 2023-02-08 00:59:33,136 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cf587d948e645a697b6b2e156bc5c00c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:59:33,559 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509079a2c3937f7e0444997d1cb3479c39fb8 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509079a2c3937f7e0444997d1cb3479c39fb8 2023-02-08 00:59:33,967 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/736d24c5a4804ada97dce7153779278d 2023-02-08 00:59:33,972 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/736d24c5a4804ada97dce7153779278d as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/736d24c5a4804ada97dce7153779278d 2023-02-08 00:59:33,976 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/736d24c5a4804ada97dce7153779278d, entries=1, sequenceid=37, filesize=4.9 K 2023-02-08 00:59:33,977 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf587d948e645a697b6b2e156bc5c00c in 841ms, sequenceid=37, compaction requested=true 2023-02-08 00:59:33,977 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:33,977 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:33,977 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:59:33,977 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:59:33,977 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:33,977 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:59:33,977 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:59:34,293 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:34,293 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:34,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:34,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:34,295 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,295 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:34,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:34,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:34,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:34,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:34,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:59:34,300 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28e68772[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:34,300 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:59:34,300 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,420 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,420 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:59:34,420 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:59:34,421 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:34,421 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:34,421 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:34,478 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:59:34,478 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:34,478 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:34,478 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:59:34,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:34,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:34,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:34,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:34,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:34,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:34,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:34,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:34,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:34,480 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:59:34,480 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:59:34,480 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:34,480 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:34,480 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,480 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:34,844 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:34,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:34,844 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,845 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:34,845 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,846 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:34,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:34,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:34,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:34,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:34,848 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:34,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:34,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:34,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:34,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:35,052 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:35,052 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:35,052 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:35,052 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:35,052 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:35,052 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:35,052 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:35,052 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:35,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:35,052 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:35,052 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:35,052 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:35,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:35,052 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:59:35,052 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:35,053 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:35,053 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:35,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:35,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:35,153 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:35,153 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:35,153 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:35,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:35,161 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:35,162 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:35,163 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:35,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:35,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:35,166 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:35,166 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:35,166 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-02-08 00:59:35,166 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-02-08 00:59:35,167 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:35,167 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:35,425 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:35,425 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:35,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:35,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:35,426 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:35,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:35,426 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:35,426 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:35,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:35,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:35,427 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:35,428 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-02-08 00:59:35,428 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:35,428 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-02-08 00:59:35,428 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:35,428 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-02-08 00:59:35,429 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-02-08 00:59:35,429 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:35,429 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:35,429 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. started... 2023-02-08 00:59:35,429 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing cf587d948e645a697b6b2e156bc5c00c 1/1 column families, dataSize=73 B heapSize=408 B 2023-02-08 00:59:35,850 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120fc44efba1ad14b36826fda578bde299a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120fc44efba1ad14b36826fda578bde299a 2023-02-08 00:59:36,262 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/2572824c4b99463ab163faaaabeb2488 2023-02-08 00:59:36,269 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/2572824c4b99463ab163faaaabeb2488 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/2572824c4b99463ab163faaaabeb2488 2023-02-08 00:59:36,277 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/2572824c4b99463ab163faaaabeb2488, entries=1, sequenceid=41, filesize=4.9 K 2023-02-08 00:59:36,278 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for cf587d948e645a697b6b2e156bc5c00c in 849ms, sequenceid=41, compaction requested=true 2023-02-08 00:59:36,279 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:36,279 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:36,279 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-02-08 00:59:36,279 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-02-08 00:59:36,279 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:36,279 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-02-08 00:59:36,279 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-02-08 00:59:36,539 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,539 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:36,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:36,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:36,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:36,540 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,540 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:36,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:36,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:36,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:36,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:36,544 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-02-08 00:59:36,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e48954b[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:36,545 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-02-08 00:59:36,545 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,601 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,602 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-02-08 00:59:36,602 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-02-08 00:59:36,602 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:36,602 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:36,602 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:36,646 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-02-08 00:59:36,646 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:36,647 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:36,647 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-02-08 00:59:36,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:36,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:36,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:36,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:36,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:36,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:36,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:36,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:36,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:36,656 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-02-08 00:59:36,656 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-02-08 00:59:36,656 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:36,656 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:36,656 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,656 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:36,703 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,703 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,703 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:36,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:36,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:36,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:36,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:36,705 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:36,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:36,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:36,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,708 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:36,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:36,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:36,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:36,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:37,072 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:37,072 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:37,072 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-02-08 00:59:37,073 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:37,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:37,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:37,072 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:37,073 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:37,073 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:37,072 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:37,074 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:37,072 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:37,074 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:37,074 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:37,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:37,073 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-02-08 00:59:37,074 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:37,074 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:37,075 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:37,174 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:37,174 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:37,174 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:37,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:37,273 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-02-08 00:59:37,274 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 00:59:37,275 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 00:59:37,276 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:59:37,276 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818577276 2023-02-08 00:59:37,282 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-02-08 00:59:37,283 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-02-08 00:59:37,283 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:59:37,283 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x0850fa75 to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 00:59:37,574 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cb581a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 00:59:37,575 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:59:38,409 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030089dd18ed174989af289bed64c9f591 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601030089dd18ed174989af289bed64c9f591 2023-02-08 00:59:38,410 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:59:38,426 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 00:59:38,428 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:45612, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 00:59:38,432 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:38,432 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:38,432 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 00:59:38,433 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:51842, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 00:59:38,445 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/95332d7624034d88a28772161924a360 first=Optional[r5] last=Optional[r6] 2023-02-08 00:59:38,445 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/95332d7624034d88a28772161924a360}] 2023-02-08 00:59:38,452 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/95332d7624034d88a28772161924a360 for inclusion in cf587d948e645a697b6b2e156bc5c00c/family1 2023-02-08 00:59:38,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-02-08 00:59:38,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:59:38,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:38,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/95332d7624034d88a28772161924a360 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7r9p4ueqbdqqdin87qmrri7bb9ub4k5drdptnb3rrd7fqimh7rthfr0sv93h0hqu/family1/95332d7624034d88a28772161924a360 2023-02-08 00:59:38,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7r9p4ueqbdqqdin87qmrri7bb9ub4k5drdptnb3rrd7fqimh7rthfr0sv93h0hqu/family1/95332d7624034d88a28772161924a360 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/a0650479064a463b85fd171cb1e3d0ff_SeqId_44_ 2023-02-08 00:59:38,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7r9p4ueqbdqqdin87qmrri7bb9ub4k5drdptnb3rrd7fqimh7rthfr0sv93h0hqu/family1/95332d7624034d88a28772161924a360 into cf587d948e645a697b6b2e156bc5c00c/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/a0650479064a463b85fd171cb1e3d0ff_SeqId_44_ - updating store file list. 2023-02-08 00:59:38,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/a0650479064a463b85fd171cb1e3d0ff_SeqId_44_ into cf587d948e645a697b6b2e156bc5c00c/family1 2023-02-08 00:59:38,460 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7r9p4ueqbdqqdin87qmrri7bb9ub4k5drdptnb3rrd7fqimh7rthfr0sv93h0hqu/family1/95332d7624034d88a28772161924a360 into cf587d948e645a697b6b2e156bc5c00c/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/a0650479064a463b85fd171cb1e3d0ff_SeqId_44_) 2023-02-08 00:59:38,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__7r9p4ueqbdqqdin87qmrri7bb9ub4k5drdptnb3rrd7fqimh7rthfr0sv93h0hqu/family1/95332d7624034d88a28772161924a360 2023-02-08 00:59:38,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-02-08 00:59:38,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-02-08 00:59:38,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): cf587d948e645a697b6b2e156bc5c00c/family1 is initiating minor compaction 2023-02-08 00:59:38,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4bf1a105; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:59:38,464 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of cf587d948e645a697b6b2e156bc5c00c/family1 in testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:38,464 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/a267db27d650408eb42feb15715b389b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/b09bbff2e2b04d14bc527047c708ff11, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/1739ce5e01184ed7ba326dcce2d9bc27, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/365dbaef8caa4c3fa638e07cc1e1fb02, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/8a31e31f282a4d6c8962126fbe8b80c1, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/505ff6ea13ed4d49b98be9c7eb2c7dd5, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/e72d1fcf6f7c4845a5e3cfa6ffeb7497, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/736d24c5a4804ada97dce7153779278d, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/2572824c4b99463ab163faaaabeb2488, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/a0650479064a463b85fd171cb1e3d0ff_SeqId_44_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp, totalSize=49.7 K 2023-02-08 00:59:38,464 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting a267db27d650408eb42feb15715b389b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-02-08 00:59:38,464 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting b09bbff2e2b04d14bc527047c708ff11, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-02-08 00:59:38,464 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 1739ce5e01184ed7ba326dcce2d9bc27, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-02-08 00:59:38,464 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 365dbaef8caa4c3fa638e07cc1e1fb02, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-02-08 00:59:38,464 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 8a31e31f282a4d6c8962126fbe8b80c1, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-02-08 00:59:38,464 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 505ff6ea13ed4d49b98be9c7eb2c7dd5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-02-08 00:59:38,464 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting e72d1fcf6f7c4845a5e3cfa6ffeb7497, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-02-08 00:59:38,464 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 736d24c5a4804ada97dce7153779278d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-02-08 00:59:38,464 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 2572824c4b99463ab163faaaabeb2488, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-02-08 00:59:38,464 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting a0650479064a463b85fd171cb1e3d0ff_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-02-08 00:59:38,467 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:59:38,467 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:38,469 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010148c4898243c44ed295c03f01f418bfcb to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2016010148c4898243c44ed295c03f01f418bfcb 2023-02-08 00:59:38,470 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601037ebee313787343f58d445231d45b6076 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601037ebee313787343f58d445231d45b6076 2023-02-08 00:59:38,470 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-02-08 00:59:38,470 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-02-08 00:59:38,470 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:59:38,470 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:59:38,493 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): cf587d948e645a697b6b2e156bc5c00c#family1#compaction#166 average throughput is 1.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-02-08 00:59:39,308 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/cc1f43406f694be189d1ac77e635a89a as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/cc1f43406f694be189d1ac77e635a89a 2023-02-08 00:59:39,308 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231489ef4aacd4f490d8a28a9be6b869ce1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231489ef4aacd4f490d8a28a9be6b869ce1 2023-02-08 00:59:39,309 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:59:39,313 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in cf587d948e645a697b6b2e156bc5c00c/family1 of cf587d948e645a697b6b2e156bc5c00c into cc1f43406f694be189d1ac77e635a89a(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-02-08 00:59:39,313 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:39,313 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1675817978463; duration=0sec 2023-02-08 00:59:39,313 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:59:39,326 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:39,326 INFO [MobCompactor-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:39,332 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/198b8577f9754caa8998448b13589cea first=Optional[r1] last=Optional[r4] 2023-02-08 00:59:39,333 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/198b8577f9754caa8998448b13589cea}] 2023-02-08 00:59:39,335 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/198b8577f9754caa8998448b13589cea for inclusion in cf587d948e645a697b6b2e156bc5c00c/family1 2023-02-08 00:59:39,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-02-08 00:59:39,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:59:39,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:39,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/198b8577f9754caa8998448b13589cea to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fu85ldv1d19fbjcr6fm78ijj6i6d9mpkne71amj0ckm8kf81ih4uueejp614dd1c/family1/198b8577f9754caa8998448b13589cea 2023-02-08 00:59:39,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fu85ldv1d19fbjcr6fm78ijj6i6d9mpkne71amj0ckm8kf81ih4uueejp614dd1c/family1/198b8577f9754caa8998448b13589cea as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/8bbe0b767dbb419f907e42e81148a266_SeqId_47_ 2023-02-08 00:59:39,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fu85ldv1d19fbjcr6fm78ijj6i6d9mpkne71amj0ckm8kf81ih4uueejp614dd1c/family1/198b8577f9754caa8998448b13589cea into cf587d948e645a697b6b2e156bc5c00c/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/8bbe0b767dbb419f907e42e81148a266_SeqId_47_ - updating store file list. 2023-02-08 00:59:39,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/8bbe0b767dbb419f907e42e81148a266_SeqId_47_ into cf587d948e645a697b6b2e156bc5c00c/family1 2023-02-08 00:59:39,344 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fu85ldv1d19fbjcr6fm78ijj6i6d9mpkne71amj0ckm8kf81ih4uueejp614dd1c/family1/198b8577f9754caa8998448b13589cea into cf587d948e645a697b6b2e156bc5c00c/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/8bbe0b767dbb419f907e42e81148a266_SeqId_47_) 2023-02-08 00:59:39,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__fu85ldv1d19fbjcr6fm78ijj6i6d9mpkne71amj0ckm8kf81ih4uueejp614dd1c/family1/198b8577f9754caa8998448b13589cea 2023-02-08 00:59:39,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-02-08 00:59:39,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-02-08 00:59:39,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(1912): cf587d948e645a697b6b2e156bc5c00c/family1 is initiating minor compaction (all files) 2023-02-08 00:59:39,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2db0287b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:59:39,345 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2258): Starting compaction of cf587d948e645a697b6b2e156bc5c00c/family1 in testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 00:59:39,346 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/3500cbca0e8e4628bd8bbbaf7c771037, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/cc1f43406f694be189d1ac77e635a89a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/8bbe0b767dbb419f907e42e81148a266_SeqId_47_] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp, totalSize=178.1 K 2023-02-08 00:59:39,346 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 3500cbca0e8e4628bd8bbbaf7c771037, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878836759 2023-02-08 00:59:39,346 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting cc1f43406f694be189d1ac77e635a89a, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621236759 2023-02-08 00:59:39,347 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] compactions.Compactor(207): Compacting 8bbe0b767dbb419f907e42e81148a266_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965236759 2023-02-08 00:59:39,347 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:59:39,347 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:39,349 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512018f439dd40b7348fbb4103080b0047625 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512018f439dd40b7348fbb4103080b0047625 2023-02-08 00:59:39,351 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205bf705ce8031d4d8b925a892d776e74f7 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151205bf705ce8031d4d8b925a892d776e74f7 2023-02-08 00:59:39,353 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228155c90d97bb54f3fafcdf8615fd99590 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151228155c90d97bb54f3fafcdf8615fd99590 2023-02-08 00:59:39,354 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512314068cdcaa8ea4ba18d234e06a5485bfb to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512314068cdcaa8ea4ba18d234e06a5485bfb 2023-02-08 00:59:39,354 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-02-08 00:59:39,354 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-02-08 00:59:39,355 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:59:39,355 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:59:39,359 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] throttle.PressureAwareThroughputController(145): cf587d948e645a697b6b2e156bc5c00c#family1#compaction#167 average throughput is 25.93 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 65.38 MB/second 2023-02-08 00:59:39,393 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/a267db27d650408eb42feb15715b389b, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/b09bbff2e2b04d14bc527047c708ff11, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/1739ce5e01184ed7ba326dcce2d9bc27, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/365dbaef8caa4c3fa638e07cc1e1fb02, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/8a31e31f282a4d6c8962126fbe8b80c1, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/505ff6ea13ed4d49b98be9c7eb2c7dd5, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/e72d1fcf6f7c4845a5e3cfa6ffeb7497, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/736d24c5a4804ada97dce7153779278d, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/2572824c4b99463ab163faaaabeb2488, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/a0650479064a463b85fd171cb1e3d0ff_SeqId_44_] to archive 2023-02-08 00:59:39,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:39,395 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/a267db27d650408eb42feb15715b389b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/a267db27d650408eb42feb15715b389b 2023-02-08 00:59:39,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/b09bbff2e2b04d14bc527047c708ff11 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/b09bbff2e2b04d14bc527047c708ff11 2023-02-08 00:59:39,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/1739ce5e01184ed7ba326dcce2d9bc27 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/1739ce5e01184ed7ba326dcce2d9bc27 2023-02-08 00:59:39,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/365dbaef8caa4c3fa638e07cc1e1fb02 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/365dbaef8caa4c3fa638e07cc1e1fb02 2023-02-08 00:59:39,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/8a31e31f282a4d6c8962126fbe8b80c1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/8a31e31f282a4d6c8962126fbe8b80c1 2023-02-08 00:59:39,399 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/505ff6ea13ed4d49b98be9c7eb2c7dd5 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/505ff6ea13ed4d49b98be9c7eb2c7dd5 2023-02-08 00:59:39,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/e72d1fcf6f7c4845a5e3cfa6ffeb7497 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/e72d1fcf6f7c4845a5e3cfa6ffeb7497 2023-02-08 00:59:39,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/736d24c5a4804ada97dce7153779278d to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/736d24c5a4804ada97dce7153779278d 2023-02-08 00:59:39,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/2572824c4b99463ab163faaaabeb2488 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/2572824c4b99463ab163faaaabeb2488 2023-02-08 00:59:39,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/a0650479064a463b85fd171cb1e3d0ff_SeqId_44_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/a0650479064a463b85fd171cb1e3d0ff_SeqId_44_ 2023-02-08 00:59:39,687 DEBUG [regionserver/jenkins-hbase12:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-08 00:59:39,795 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130d942651f110d4222bb630441052faac5 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130d942651f110d4222bb630441052faac5 2023-02-08 00:59:39,796 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:59:39,815 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:39,815 INFO [MobCompactor-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:39,821 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1f0c21dce8f646b7bf87b2cb6674db31 first=Optional[r00] last=Optional[r8] 2023-02-08 00:59:39,822 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1f0c21dce8f646b7bf87b2cb6674db31}] 2023-02-08 00:59:39,824 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1f0c21dce8f646b7bf87b2cb6674db31 for inclusion in cf587d948e645a697b6b2e156bc5c00c/family1 2023-02-08 00:59:39,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-02-08 00:59:39,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last= 2023-02-08 00:59:39,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:39,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1f0c21dce8f646b7bf87b2cb6674db31 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__t3vvbbk93ndcu6uiro03g55s1scl7dgp5ho6ts1n750qt146od7u6m6quo0n0ahf/family1/1f0c21dce8f646b7bf87b2cb6674db31 2023-02-08 00:59:39,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__t3vvbbk93ndcu6uiro03g55s1scl7dgp5ho6ts1n750qt146od7u6m6quo0n0ahf/family1/1f0c21dce8f646b7bf87b2cb6674db31 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/c3a85d5168cb4e4287e43c6d1b42eb8c_SeqId_49_ 2023-02-08 00:59:39,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__t3vvbbk93ndcu6uiro03g55s1scl7dgp5ho6ts1n750qt146od7u6m6quo0n0ahf/family1/1f0c21dce8f646b7bf87b2cb6674db31 into cf587d948e645a697b6b2e156bc5c00c/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/c3a85d5168cb4e4287e43c6d1b42eb8c_SeqId_49_ - updating store file list. 2023-02-08 00:59:39,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/c3a85d5168cb4e4287e43c6d1b42eb8c_SeqId_49_ into cf587d948e645a697b6b2e156bc5c00c/family1 2023-02-08 00:59:39,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__t3vvbbk93ndcu6uiro03g55s1scl7dgp5ho6ts1n750qt146od7u6m6quo0n0ahf/family1/1f0c21dce8f646b7bf87b2cb6674db31 into cf587d948e645a697b6b2e156bc5c00c/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/c3a85d5168cb4e4287e43c6d1b42eb8c_SeqId_49_) 2023-02-08 00:59:39,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMinorCompactionWithMonthlyPolicy__t3vvbbk93ndcu6uiro03g55s1scl7dgp5ho6ts1n750qt146od7u6m6quo0n0ahf/family1/1f0c21dce8f646b7bf87b2cb6674db31 2023-02-08 00:59:39,837 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:59:39,837 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:39,839 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120fc44efba1ad14b36826fda578bde299a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120fc44efba1ad14b36826fda578bde299a 2023-02-08 00:59:39,840 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128a3bcec7ec3a24b6d93292b249485b351 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151128a3bcec7ec3a24b6d93292b249485b351 2023-02-08 00:59:39,841 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511306d6b324c6a4a4770a60a6e1d693cc521 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511306d6b324c6a4a4770a60a6e1d693cc521 2023-02-08 00:59:39,841 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-02-08 00:59:39,841 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-02-08 00:59:39,842 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:59:39,842 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:59:39,842 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-02-08 00:59:39,842 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-02-08 00:59:39,842 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 00:59:39,844 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-02-08 00:59:39,845 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.5700 sec 2023-02-08 00:59:40,052 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=260 (was 243) - Thread LEAK? -, OpenFileDescriptor=650 (was 599) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=315 (was 322), ProcessCount=176 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=3597 (was 3982) 2023-02-08 00:59:40,063 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=260, OpenFileDescriptor=650, MaxFileDescriptor=60000, SystemLoadAverage=315, ProcessCount=176, AvailableMemoryMB=3596 2023-02-08 00:59:40,088 DEBUG [Listener at localhost.localdomain/36213] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-02-08 00:59:40,118 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:40,118 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:40,146 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.HMaster$4(2102): Client=jenkins//136.243.104.168 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x89G9\xB4@/\xFC\xABc\x8D)\xED&\xC4\x15\xDC"\x10`\xAB\x84\xA7#\x0FS\x9F)jk\xC3\xBC\x9COq*\x10pY\x8Ep\x8BD&\xEF\x9FFGp\xB8\xF7\xE0\xC22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-02-08 00:59:40,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure2.ProcedureExecutor(1029): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-02-08 00:59:40,148 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-02-08 00:59:40,148 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(697): Client=jenkins//136.243.104.168 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-02-08 00:59:40,148 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:40,148 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:40,148 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-02-08 00:59:40,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-08 00:59:40,150 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926 2023-02-08 00:59:40,150 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc 2023-02-08 00:59:40,151 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069 2023-02-08 00:59:40,151 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926 empty. 2023-02-08 00:59:40,151 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc empty. 2023-02-08 00:59:40,151 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069 empty. 2023-02-08 00:59:40,151 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926 2023-02-08 00:59:40,151 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc 2023-02-08 00:59:40,151 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069 2023-02-08 00:59:40,151 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-02-08 00:59:40,249 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:40,250 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:40,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-08 00:59:40,451 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:40,451 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:40,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-08 00:59:40,561 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-02-08 00:59:40,564 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7671): creating {ENCODED => ede7c7bf0bdac5985188410295f2c926, NAME => 'testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x89G9\xB4@/\xFC\xABc\x8D)\xED&\xC4\x15\xDC"\x10`\xAB\x84\xA7#\x0FS\x9F)jk\xC3\xBC\x9COq*\x10pY\x8Ep\x8BD&\xEF\x9FFGp\xB8\xF7\xE0\xC22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:59:40,566 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7671): creating {ENCODED => 8c482904a595e426d85ba975310b4bcc, NAME => 'testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x89G9\xB4@/\xFC\xABc\x8D)\xED&\xC4\x15\xDC"\x10`\xAB\x84\xA7#\x0FS\x9F)jk\xC3\xBC\x9COq*\x10pY\x8Ep\x8BD&\xEF\x9FFGp\xB8\xF7\xE0\xC22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:59:40,566 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7671): creating {ENCODED => 3c9a9a588c7dcedde3924f81c89eb069, NAME => 'testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x89G9\xB4@/\xFC\xABc\x8D)\xED&\xC4\x15\xDC"\x10`\xAB\x84\xA7#\x0FS\x9F)jk\xC3\xBC\x9COq*\x10pY\x8Ep\x8BD&\xEF\x9FFGp\xB8\xF7\xE0\xC22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/.tmp 2023-02-08 00:59:40,573 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:59:40,574 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1603): Closing ede7c7bf0bdac5985188410295f2c926, disabling compactions & flushes 2023-02-08 00:59:40,574 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:40,574 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:40,574 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. after waiting 0 ms 2023-02-08 00:59:40,574 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:40,574 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:40,574 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1557): Region close journal for ede7c7bf0bdac5985188410295f2c926: Waiting for close lock at 1675817980574Disabling compacts and flushes for region at 1675817980574Disabling writes for close at 1675817980574Writing region close event to WAL at 1675817980574Closed at 1675817980574 2023-02-08 00:59:40,589 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/.tmp/family1/7d5626732571445cbb483a841e1c1aad as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/7d5626732571445cbb483a841e1c1aad 2023-02-08 00:59:40,594 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in cf587d948e645a697b6b2e156bc5c00c/family1 of cf587d948e645a697b6b2e156bc5c00c into 7d5626732571445cbb483a841e1c1aad(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:59:40,594 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.HRegion(2288): Compaction status journal for cf587d948e645a697b6b2e156bc5c00c: 2023-02-08 00:59:40,594 INFO [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1675817979345; duration=1sec 2023-02-08 00:59:40,594 DEBUG [RS:0;jenkins-hbase12:36907-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-02-08 00:59:40,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/3500cbca0e8e4628bd8bbbaf7c771037, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/cc1f43406f694be189d1ac77e635a89a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/8bbe0b767dbb419f907e42e81148a266_SeqId_47_] to archive 2023-02-08 00:59:40,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:40,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/3500cbca0e8e4628bd8bbbaf7c771037 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/3500cbca0e8e4628bd8bbbaf7c771037 2023-02-08 00:59:40,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/cc1f43406f694be189d1ac77e635a89a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/cc1f43406f694be189d1ac77e635a89a 2023-02-08 00:59:40,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/8bbe0b767dbb419f907e42e81148a266_SeqId_47_ to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/family1/8bbe0b767dbb419f907e42e81148a266_SeqId_47_ 2023-02-08 00:59:40,754 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:40,754 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:40,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-08 00:59:40,941 DEBUG [regionserver/jenkins-hbase12:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-08 00:59:40,974 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:59:40,974 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:59:40,974 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1603): Closing 8c482904a595e426d85ba975310b4bcc, disabling compactions & flushes 2023-02-08 00:59:40,974 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:40,974 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:40,975 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. after waiting 0 ms 2023-02-08 00:59:40,975 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:40,974 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1603): Closing 3c9a9a588c7dcedde3924f81c89eb069, disabling compactions & flushes 2023-02-08 00:59:40,975 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:40,975 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:40,975 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1557): Region close journal for 8c482904a595e426d85ba975310b4bcc: Waiting for close lock at 1675817980974Disabling compacts and flushes for region at 1675817980974Disabling writes for close at 1675817980975 (+1 ms)Writing region close event to WAL at 1675817980975Closed at 1675817980975 2023-02-08 00:59:40,975 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:40,975 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. after waiting 0 ms 2023-02-08 00:59:40,975 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:40,975 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:40,975 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1557): Region close journal for 3c9a9a588c7dcedde3924f81c89eb069: Waiting for close lock at 1675817980974Disabling compacts and flushes for region at 1675817980974Disabling writes for close at 1675817980975 (+1 ms)Writing region close event to WAL at 1675817980975Closed at 1675817980975 2023-02-08 00:59:40,979 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-02-08 00:59:40,981 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675817980980"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817980980"}]},"ts":"1675817980980"} 2023-02-08 00:59:40,981 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675817980980"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817980980"}]},"ts":"1675817980980"} 2023-02-08 00:59:40,981 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675817980980"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1675817980980"}]},"ts":"1675817980980"} 2023-02-08 00:59:40,984 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-02-08 00:59:40,985 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-02-08 00:59:40,986 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817980985"}]},"ts":"1675817980985"} 2023-02-08 00:59:40,987 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-02-08 00:59:41,255 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:41,255 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:41,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-08 00:59:41,284 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ede7c7bf0bdac5985188410295f2c926, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8c482904a595e426d85ba975310b4bcc, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3c9a9a588c7dcedde3924f81c89eb069, ASSIGN}] 2023-02-08 00:59:41,287 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ede7c7bf0bdac5985188410295f2c926, ASSIGN 2023-02-08 00:59:41,287 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3c9a9a588c7dcedde3924f81c89eb069, ASSIGN 2023-02-08 00:59:41,287 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8c482904a595e426d85ba975310b4bcc, ASSIGN 2023-02-08 00:59:41,288 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ede7c7bf0bdac5985188410295f2c926, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:59:41,289 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3c9a9a588c7dcedde3924f81c89eb069, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:59:41,289 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8c482904a595e426d85ba975310b4bcc, ASSIGN; state=OFFLINE, location=jenkins-hbase12.apache.org,36907,1675817727419; forceNewPlan=false, retain=false 2023-02-08 00:59:41,441 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=ede7c7bf0bdac5985188410295f2c926, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:41,441 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=8c482904a595e426d85ba975310b4bcc, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:41,441 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=3c9a9a588c7dcedde3924f81c89eb069, regionState=OPENING, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:41,441 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675817981441"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817981441"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817981441"}]},"ts":"1675817981441"} 2023-02-08 00:59:41,441 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675817981441"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817981441"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817981441"}]},"ts":"1675817981441"} 2023-02-08 00:59:41,441 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675817981441"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1675817981441"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1675817981441"}]},"ts":"1675817981441"} 2023-02-08 00:59:41,443 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=120, ppid=118, state=RUNNABLE; OpenRegionProcedure 8c482904a595e426d85ba975310b4bcc, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:59:41,443 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=121, ppid=119, state=RUNNABLE; OpenRegionProcedure 3c9a9a588c7dcedde3924f81c89eb069, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:59:41,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure ede7c7bf0bdac5985188410295f2c926, server=jenkins-hbase12.apache.org,36907,1675817727419}] 2023-02-08 00:59:41,600 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:41,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 8c482904a595e426d85ba975310b4bcc, NAME => 'testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc.', STARTKEY => '1', ENDKEY => '2'} 2023-02-08 00:59:41,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 8c482904a595e426d85ba975310b4bcc 2023-02-08 00:59:41,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:59:41,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 8c482904a595e426d85ba975310b4bcc 2023-02-08 00:59:41,601 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 8c482904a595e426d85ba975310b4bcc 2023-02-08 00:59:41,626 INFO [StoreOpener-8c482904a595e426d85ba975310b4bcc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 8c482904a595e426d85ba975310b4bcc 2023-02-08 00:59:41,628 DEBUG [StoreOpener-8c482904a595e426d85ba975310b4bcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1 2023-02-08 00:59:41,628 DEBUG [StoreOpener-8c482904a595e426d85ba975310b4bcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1 2023-02-08 00:59:41,628 INFO [StoreOpener-8c482904a595e426d85ba975310b4bcc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c482904a595e426d85ba975310b4bcc columnFamilyName family1 2023-02-08 00:59:41,630 INFO [StoreOpener-8c482904a595e426d85ba975310b4bcc-1] regionserver.HStore(310): Store=8c482904a595e426d85ba975310b4bcc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:59:41,630 INFO [StoreOpener-8c482904a595e426d85ba975310b4bcc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 8c482904a595e426d85ba975310b4bcc 2023-02-08 00:59:41,631 DEBUG [StoreOpener-8c482904a595e426d85ba975310b4bcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2 2023-02-08 00:59:41,631 DEBUG [StoreOpener-8c482904a595e426d85ba975310b4bcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2 2023-02-08 00:59:41,631 INFO [StoreOpener-8c482904a595e426d85ba975310b4bcc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c482904a595e426d85ba975310b4bcc columnFamilyName family2 2023-02-08 00:59:41,632 INFO [StoreOpener-8c482904a595e426d85ba975310b4bcc-1] regionserver.HStore(310): Store=8c482904a595e426d85ba975310b4bcc/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:59:41,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc 2023-02-08 00:59:41,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc 2023-02-08 00:59:41,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:59:41,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 8c482904a595e426d85ba975310b4bcc 2023-02-08 00:59:41,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:59:41,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 8c482904a595e426d85ba975310b4bcc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68709438, jitterRate=0.02385041117668152}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:59:41,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 8c482904a595e426d85ba975310b4bcc: Running coprocessor pre-open hook at 1675817981601Writing region info on filesystem at 1675817981601Initializing all the Stores at 1675817981603 (+2 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x89G9\xB4@/\xFC\xABc\x8D)\xED&\xC4\x15\xDC"\x10`\xAB\x84\xA7#\x0FS\x9F)jk\xC3\xBC\x9COq*\x10pY\x8Ep\x8BD&\xEF\x9FFGp\xB8\xF7\xE0\xC22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817981603Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817981603Cleaning up temporary data from old regions at 1675817981634 (+31 ms)Cleaning up detritus from prior splits at 1675817981634Running coprocessor post-open hooks at 1675817981638 (+4 ms)Region opened successfully at 1675817981638 2023-02-08 00:59:41,638 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc., pid=120, masterSystemTime=1675817981595 2023-02-08 00:59:41,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:41,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:41,640 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:41,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => ede7c7bf0bdac5985188410295f2c926, NAME => 'testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926.', STARTKEY => '', ENDKEY => '1'} 2023-02-08 00:59:41,640 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=8c482904a595e426d85ba975310b4bcc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:41,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin ede7c7bf0bdac5985188410295f2c926 2023-02-08 00:59:41,640 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1675817981640"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817981640"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817981640"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817981640"}]},"ts":"1675817981640"} 2023-02-08 00:59:41,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:59:41,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for ede7c7bf0bdac5985188410295f2c926 2023-02-08 00:59:41,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for ede7c7bf0bdac5985188410295f2c926 2023-02-08 00:59:41,643 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=120, resume processing ppid=118 2023-02-08 00:59:41,643 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=120, ppid=118, state=SUCCESS; OpenRegionProcedure 8c482904a595e426d85ba975310b4bcc, server=jenkins-hbase12.apache.org,36907,1675817727419 in 198 msec 2023-02-08 00:59:41,644 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=8c482904a595e426d85ba975310b4bcc, ASSIGN in 359 msec 2023-02-08 00:59:41,660 INFO [StoreOpener-ede7c7bf0bdac5985188410295f2c926-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ede7c7bf0bdac5985188410295f2c926 2023-02-08 00:59:41,662 DEBUG [StoreOpener-ede7c7bf0bdac5985188410295f2c926-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1 2023-02-08 00:59:41,662 DEBUG [StoreOpener-ede7c7bf0bdac5985188410295f2c926-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1 2023-02-08 00:59:41,662 INFO [StoreOpener-ede7c7bf0bdac5985188410295f2c926-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ede7c7bf0bdac5985188410295f2c926 columnFamilyName family1 2023-02-08 00:59:41,663 INFO [StoreOpener-ede7c7bf0bdac5985188410295f2c926-1] regionserver.HStore(310): Store=ede7c7bf0bdac5985188410295f2c926/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:59:41,663 INFO [StoreOpener-ede7c7bf0bdac5985188410295f2c926-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ede7c7bf0bdac5985188410295f2c926 2023-02-08 00:59:41,664 DEBUG [StoreOpener-ede7c7bf0bdac5985188410295f2c926-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2 2023-02-08 00:59:41,664 DEBUG [StoreOpener-ede7c7bf0bdac5985188410295f2c926-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2 2023-02-08 00:59:41,664 INFO [StoreOpener-ede7c7bf0bdac5985188410295f2c926-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ede7c7bf0bdac5985188410295f2c926 columnFamilyName family2 2023-02-08 00:59:41,665 INFO [StoreOpener-ede7c7bf0bdac5985188410295f2c926-1] regionserver.HStore(310): Store=ede7c7bf0bdac5985188410295f2c926/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:59:41,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926 2023-02-08 00:59:41,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926 2023-02-08 00:59:41,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:59:41,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for ede7c7bf0bdac5985188410295f2c926 2023-02-08 00:59:41,668 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:59:41,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened ede7c7bf0bdac5985188410295f2c926; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59234039, jitterRate=-0.11734403669834137}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:59:41,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for ede7c7bf0bdac5985188410295f2c926: Running coprocessor pre-open hook at 1675817981640Writing region info on filesystem at 1675817981640Initializing all the Stores at 1675817981641 (+1 ms)Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x89G9\xB4@/\xFC\xABc\x8D)\xED&\xC4\x15\xDC"\x10`\xAB\x84\xA7#\x0FS\x9F)jk\xC3\xBC\x9COq*\x10pY\x8Ep\x8BD&\xEF\x9FFGp\xB8\xF7\xE0\xC22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817981641Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817981641Cleaning up temporary data from old regions at 1675817981666 (+25 ms)Cleaning up detritus from prior splits at 1675817981667 (+1 ms)Running coprocessor post-open hooks at 1675817981669 (+2 ms)Region opened successfully at 1675817981669 2023-02-08 00:59:41,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926., pid=122, masterSystemTime=1675817981595 2023-02-08 00:59:41,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:41,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:41,670 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(128): Open testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:41,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7850): Opening region: {ENCODED => 3c9a9a588c7dcedde3924f81c89eb069, NAME => 'testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069.', STARTKEY => '2', ENDKEY => ''} 2023-02-08 00:59:41,671 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=ede7c7bf0bdac5985188410295f2c926, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:41,671 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675817981671"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817981671"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817981671"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817981671"}]},"ts":"1675817981671"} 2023-02-08 00:59:41,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 3c9a9a588c7dcedde3924f81c89eb069 2023-02-08 00:59:41,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(865): Instantiated testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-02-08 00:59:41,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7890): checking encryption for 3c9a9a588c7dcedde3924f81c89eb069 2023-02-08 00:59:41,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(7893): checking classloading for 3c9a9a588c7dcedde3924f81c89eb069 2023-02-08 00:59:41,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=122, resume processing ppid=117 2023-02-08 00:59:41,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure ede7c7bf0bdac5985188410295f2c926, server=jenkins-hbase12.apache.org,36907,1675817727419 in 228 msec 2023-02-08 00:59:41,673 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ede7c7bf0bdac5985188410295f2c926, ASSIGN in 388 msec 2023-02-08 00:59:41,689 INFO [StoreOpener-3c9a9a588c7dcedde3924f81c89eb069-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3c9a9a588c7dcedde3924f81c89eb069 2023-02-08 00:59:41,690 DEBUG [StoreOpener-3c9a9a588c7dcedde3924f81c89eb069-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1 2023-02-08 00:59:41,691 DEBUG [StoreOpener-3c9a9a588c7dcedde3924f81c89eb069-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1 2023-02-08 00:59:41,691 INFO [StoreOpener-3c9a9a588c7dcedde3924f81c89eb069-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c9a9a588c7dcedde3924f81c89eb069 columnFamilyName family1 2023-02-08 00:59:41,692 INFO [StoreOpener-3c9a9a588c7dcedde3924f81c89eb069-1] regionserver.HStore(310): Store=3c9a9a588c7dcedde3924f81c89eb069/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:59:41,692 INFO [StoreOpener-3c9a9a588c7dcedde3924f81c89eb069-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3c9a9a588c7dcedde3924f81c89eb069 2023-02-08 00:59:41,693 DEBUG [StoreOpener-3c9a9a588c7dcedde3924f81c89eb069-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2 2023-02-08 00:59:41,693 DEBUG [StoreOpener-3c9a9a588c7dcedde3924f81c89eb069-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2 2023-02-08 00:59:41,693 INFO [StoreOpener-3c9a9a588c7dcedde3924f81c89eb069-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3c9a9a588c7dcedde3924f81c89eb069 columnFamilyName family2 2023-02-08 00:59:41,694 INFO [StoreOpener-3c9a9a588c7dcedde3924f81c89eb069-1] regionserver.HStore(310): Store=3c9a9a588c7dcedde3924f81c89eb069/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-02-08 00:59:41,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069 2023-02-08 00:59:41,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(5208): Found 0 recovered edits file(s) under hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069 2023-02-08 00:59:41,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-02-08 00:59:41,697 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1054): writing seq id for 3c9a9a588c7dcedde3924f81c89eb069 2023-02-08 00:59:41,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-02-08 00:59:41,698 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1071): Opened 3c9a9a588c7dcedde3924f81c89eb069; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60702608, jitterRate=-0.09546065330505371}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-02-08 00:59:41,698 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(964): Region open journal for 3c9a9a588c7dcedde3924f81c89eb069: Running coprocessor pre-open hook at 1675817981671Writing region info on filesystem at 1675817981671Initializing all the Stores at 1675817981671Instantiating store for column family {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x89G9\xB4@/\xFC\xABc\x8D)\xED&\xC4\x15\xDC"\x10`\xAB\x84\xA7#\x0FS\x9F)jk\xC3\xBC\x9COq*\x10pY\x8Ep\x8BD&\xEF\x9FFGp\xB8\xF7\xE0\xC22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817981671Instantiating store for column family {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} at 1675817981672 (+1 ms)Cleaning up temporary data from old regions at 1675817981695 (+23 ms)Cleaning up detritus from prior splits at 1675817981695Running coprocessor post-open hooks at 1675817981698 (+3 ms)Region opened successfully at 1675817981698 2023-02-08 00:59:41,699 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2335): Post open deploy tasks for testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069., pid=121, masterSystemTime=1675817981595 2023-02-08 00:59:41,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionServer(2362): Finished post open deploy task for testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:41,700 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase12:0-0] handler.AssignRegionHandler(156): Opened testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:41,700 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=3c9a9a588c7dcedde3924f81c89eb069, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:41,700 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1675817981700"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1675817981700"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1675817981700"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1675817981700"}]},"ts":"1675817981700"} 2023-02-08 00:59:41,701 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=121, resume processing ppid=119 2023-02-08 00:59:41,702 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=121, ppid=119, state=SUCCESS; OpenRegionProcedure 3c9a9a588c7dcedde3924f81c89eb069, server=jenkins-hbase12.apache.org,36907,1675817727419 in 258 msec 2023-02-08 00:59:41,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=119, resume processing ppid=116 2023-02-08 00:59:41,702 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3c9a9a588c7dcedde3924f81c89eb069, ASSIGN in 418 msec 2023-02-08 00:59:41,703 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-02-08 00:59:41,703 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1675817981703"}]},"ts":"1675817981703"} 2023-02-08 00:59:41,704 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-02-08 00:59:41,758 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-02-08 00:59:41,762 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.6120 sec 2023-02-08 00:59:42,205 DEBUG [regionserver/jenkins-hbase12:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-08 00:59:42,256 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:42,256 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:42,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1227): Checking to see if procedure is done pid=116 2023-02-08 00:59:42,257 INFO [Listener at localhost.localdomain/36213] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-02-08 00:59:42,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:42,264 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:42,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:42,266 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:42,266 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:42,266 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:42,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-08 00:59:42,268 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-08 00:59:42,268 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:42,268 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-08 00:59:42,268 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-08 00:59:42,269 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:42,269 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:42,292 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:42,292 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:42,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:42,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:42,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:42,293 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:42,293 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:42,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:42,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:42,294 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-08 00:59:42,294 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-08 00:59:42,294 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-08 00:59:42,294 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:42,294 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-08 00:59:42,294 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:42,294 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:42,294 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. started... 2023-02-08 00:59:42,294 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:59:42,295 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:42,294 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. started... 2023-02-08 00:59:42,295 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ede7c7bf0bdac5985188410295f2c926 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 00:59:42,296 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8c482904a595e426d85ba975310b4bcc 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 00:59:42,294 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:42,296 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. started... 2023-02-08 00:59:42,296 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3c9a9a588c7dcedde3924f81c89eb069 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-02-08 00:59:42,336 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208947ed1d089a749f089a7623820bae44a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230208947ed1d089a749f089a7623820bae44a 2023-02-08 00:59:42,744 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:59:42,745 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0850fa75 to 127.0.0.1:49726 2023-02-08 00:59:42,745 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:59:42,745 INFO [Finalizer] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 00:59:42,745 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4576ae8d to 127.0.0.1:49726 2023-02-08 00:59:42,746 DEBUG [Finalizer] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 00:59:42,751 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208aa5af1f75cd94aa7b78f176df9a52b07 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208aa5af1f75cd94aa7b78f176df9a52b07 2023-02-08 00:59:42,751 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208531efc5f9628424fbb2a4745114da7a2 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208531efc5f9628424fbb2a4745114da7a2 2023-02-08 00:59:42,752 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family1/6f373ab6c4a74dc9b4b46b4c60b18f8c 2023-02-08 00:59:43,165 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family1/4a64253155894613b5d7c0d3bf7563bc 2023-02-08 00:59:43,165 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family1/6d6a9ef3103d42b58a8fa60247c5bfff 2023-02-08 00:59:43,181 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208a5b4004dcc604306bb5e73ce26cde364 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230208a5b4004dcc604306bb5e73ce26cde364 2023-02-08 00:59:43,184 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family2/bd41cb43be3c463dac48e07df793cb1f 2023-02-08 00:59:43,188 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family1/6f373ab6c4a74dc9b4b46b4c60b18f8c as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/6f373ab6c4a74dc9b4b46b4c60b18f8c 2023-02-08 00:59:43,213 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/6f373ab6c4a74dc9b4b46b4c60b18f8c, entries=4, sequenceid=5, filesize=5.5 K 2023-02-08 00:59:43,214 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family2/bd41cb43be3c463dac48e07df793cb1f as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/bd41cb43be3c463dac48e07df793cb1f 2023-02-08 00:59:43,216 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/bd41cb43be3c463dac48e07df793cb1f, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 00:59:43,217 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 8c482904a595e426d85ba975310b4bcc in 921ms, sequenceid=5, compaction requested=false 2023-02-08 00:59:43,217 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-02-08 00:59:43,217 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8c482904a595e426d85ba975310b4bcc: 2023-02-08 00:59:43,217 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:43,217 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:59:43,460 DEBUG [regionserver/jenkins-hbase12:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-08 00:59:43,613 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208ab3a6c43c62f40fabd152ea5ed7ac4b7 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230208ab3a6c43c62f40fabd152ea5ed7ac4b7 2023-02-08 00:59:43,614 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020845187482472e42939a63284d3a30c5c9 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023020845187482472e42939a63284d3a30c5c9 2023-02-08 00:59:44,020 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family2/dd1e5320ca0c4f49a2cbe3248ae6ab30 2023-02-08 00:59:44,024 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family1/6d6a9ef3103d42b58a8fa60247c5bfff as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/6d6a9ef3103d42b58a8fa60247c5bfff 2023-02-08 00:59:44,024 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family2/fd74f3534bb645a6aff947f36c9b1772 2023-02-08 00:59:44,028 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family1/4a64253155894613b5d7c0d3bf7563bc as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/4a64253155894613b5d7c0d3bf7563bc 2023-02-08 00:59:44,047 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/6d6a9ef3103d42b58a8fa60247c5bfff, entries=4, sequenceid=5, filesize=5.5 K 2023-02-08 00:59:44,048 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family2/dd1e5320ca0c4f49a2cbe3248ae6ab30 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/dd1e5320ca0c4f49a2cbe3248ae6ab30 2023-02-08 00:59:44,050 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/4a64253155894613b5d7c0d3bf7563bc, entries=4, sequenceid=5, filesize=5.5 K 2023-02-08 00:59:44,051 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family2/fd74f3534bb645a6aff947f36c9b1772 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/fd74f3534bb645a6aff947f36c9b1772 2023-02-08 00:59:44,053 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/dd1e5320ca0c4f49a2cbe3248ae6ab30, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 00:59:44,054 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ede7c7bf0bdac5985188410295f2c926 in 1759ms, sequenceid=5, compaction requested=false 2023-02-08 00:59:44,055 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ede7c7bf0bdac5985188410295f2c926: 2023-02-08 00:59:44,055 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:44,055 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:59:44,056 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/fd74f3534bb645a6aff947f36c9b1772, entries=2, sequenceid=5, filesize=5.1 K 2023-02-08 00:59:44,056 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3c9a9a588c7dcedde3924f81c89eb069 in 1760ms, sequenceid=5, compaction requested=false 2023-02-08 00:59:44,056 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3c9a9a588c7dcedde3924f81c89eb069: 2023-02-08 00:59:44,056 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:44,056 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:59:44,056 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:59:44,056 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,056 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-08 00:59:44,057 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-08 00:59:44,071 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:44,071 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:44,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:44,072 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:44,072 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:44,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:44,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:44,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:44,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:44,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-08 00:59:44,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d7d661f[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:44,073 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-08 00:59:44,073 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:44,303 DEBUG [regionserver/jenkins-hbase12:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-08 00:59:44,372 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:44,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:44,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:44,372 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-08 00:59:44,372 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-08 00:59:44,373 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,373 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:44,373 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:44,398 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,398 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-08 00:59:44,398 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:44,398 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-08 00:59:44,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:44,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:44,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:44,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:44,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:44,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:44,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:44,402 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-08 00:59:44,402 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-08 00:59:44,402 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:44,402 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:44,402 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-08 00:59:44,402 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:44,419 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:44,419 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:44,419 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:44,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:44,419 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:44,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:44,421 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,510 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,510 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:44,510 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:44,511 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:44,510 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:44,511 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-08 00:59:44,511 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:44,511 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:44,511 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:44,511 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:44,511 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:44,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-08 00:59:44,511 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:44,511 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:44,511 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:44,512 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:44,611 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:44,611 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:44,612 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:44,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:44,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:44,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:44,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:44,616 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:44,616 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:44,617 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:44,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:44,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-08 00:59:44,618 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-08 00:59:44,618 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:44,618 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-08 00:59:44,618 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-08 00:59:44,619 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:44,619 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:44,919 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:44,919 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:44,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:44,919 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:44,920 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:44,920 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:44,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:44,920 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-08 00:59:44,920 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-08 00:59:44,920 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-08 00:59:44,920 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-08 00:59:44,920 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:44,921 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-08 00:59:44,921 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:44,921 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. started... 2023-02-08 00:59:44,921 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:44,921 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:59:44,921 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:44,921 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. started... 2023-02-08 00:59:44,921 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:44,921 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8c482904a595e426d85ba975310b4bcc 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 00:59:44,921 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ede7c7bf0bdac5985188410295f2c926 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 00:59:44,921 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. started... 2023-02-08 00:59:44,921 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3c9a9a588c7dcedde3924f81c89eb069 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-02-08 00:59:44,960 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020829f52463fb084edaae2fc2c3f3809471 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020829f52463fb084edaae2fc2c3f3809471 2023-02-08 00:59:45,370 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208596ced569c3e4955b16206c2d26bc33e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208596ced569c3e4955b16206c2d26bc33e 2023-02-08 00:59:45,372 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family1/7c07109bd90e4ac7b2fc221fcde79714 2023-02-08 00:59:45,376 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020811f9fe8de99d4738a201e2b4aa161107 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020811f9fe8de99d4738a201e2b4aa161107 2023-02-08 00:59:45,565 DEBUG [regionserver/jenkins-hbase12:0.Chore.2] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-02-08 00:59:45,788 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family1/5e51f9ae29b24e5d8cbfbe2cd6930509 2023-02-08 00:59:45,791 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family1/9cda0c4ed7f04614b7af8cff0882031c 2023-02-08 00:59:45,807 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302081c7f719954dd4f6aaeb2167e290fa609 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302081c7f719954dd4f6aaeb2167e290fa609 2023-02-08 00:59:45,825 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020897bcfc2fd83041c992551d1570ce7335 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023020897bcfc2fd83041c992551d1570ce7335 2023-02-08 00:59:46,212 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family2/ba954ed31efc4867968956289ee92ee2 2023-02-08 00:59:46,218 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family1/7c07109bd90e4ac7b2fc221fcde79714 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/7c07109bd90e4ac7b2fc221fcde79714 2023-02-08 00:59:46,228 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208d7fa68d385354ce1ab8e58ca83ceb4e3 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230208d7fa68d385354ce1ab8e58ca83ceb4e3 2023-02-08 00:59:46,229 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family2/49d80eaa5c0a43a99432cee5610b4003 2023-02-08 00:59:46,234 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family1/5e51f9ae29b24e5d8cbfbe2cd6930509 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/5e51f9ae29b24e5d8cbfbe2cd6930509 2023-02-08 00:59:46,235 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family2/5202461b8c224a92938f36f9cbdae500 2023-02-08 00:59:46,238 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family1/9cda0c4ed7f04614b7af8cff0882031c as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/9cda0c4ed7f04614b7af8cff0882031c 2023-02-08 00:59:46,246 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/7c07109bd90e4ac7b2fc221fcde79714, entries=4, sequenceid=9, filesize=5.5 K 2023-02-08 00:59:46,247 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family2/ba954ed31efc4867968956289ee92ee2 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/ba954ed31efc4867968956289ee92ee2 2023-02-08 00:59:46,249 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/ba954ed31efc4867968956289ee92ee2, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 00:59:46,250 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ede7c7bf0bdac5985188410295f2c926 in 1329ms, sequenceid=9, compaction requested=false 2023-02-08 00:59:46,250 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ede7c7bf0bdac5985188410295f2c926: 2023-02-08 00:59:46,250 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:46,250 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:59:46,254 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/5e51f9ae29b24e5d8cbfbe2cd6930509, entries=4, sequenceid=9, filesize=5.5 K 2023-02-08 00:59:46,255 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family2/49d80eaa5c0a43a99432cee5610b4003 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/49d80eaa5c0a43a99432cee5610b4003 2023-02-08 00:59:46,257 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/9cda0c4ed7f04614b7af8cff0882031c, entries=4, sequenceid=9, filesize=5.5 K 2023-02-08 00:59:46,258 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family2/5202461b8c224a92938f36f9cbdae500 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/5202461b8c224a92938f36f9cbdae500 2023-02-08 00:59:46,258 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/49d80eaa5c0a43a99432cee5610b4003, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 00:59:46,258 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3c9a9a588c7dcedde3924f81c89eb069 in 1337ms, sequenceid=9, compaction requested=false 2023-02-08 00:59:46,259 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3c9a9a588c7dcedde3924f81c89eb069: 2023-02-08 00:59:46,259 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:46,259 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:59:46,261 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/5202461b8c224a92938f36f9cbdae500, entries=2, sequenceid=9, filesize=5.1 K 2023-02-08 00:59:46,261 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 8c482904a595e426d85ba975310b4bcc in 1340ms, sequenceid=9, compaction requested=false 2023-02-08 00:59:46,261 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8c482904a595e426d85ba975310b4bcc: 2023-02-08 00:59:46,261 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:46,261 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:59:46,261 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:59:46,261 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,261 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-08 00:59:46,261 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-08 00:59:46,360 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,360 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:46,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:46,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:46,360 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:46,360 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:46,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:46,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:46,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:46,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:46,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-08 00:59:46,363 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4251f186[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:46,363 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-08 00:59:46,363 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:46,426 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:46,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:46,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:46,427 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-08 00:59:46,427 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-08 00:59:46,427 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:46,427 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,427 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:46,490 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-08 00:59:46,490 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:46,490 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-08 00:59:46,490 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:46,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:46,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:46,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:46,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:46,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:46,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:46,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:46,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-08 00:59:46,498 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-08 00:59:46,499 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:46,499 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:46,499 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-08 00:59:46,499 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:46,782 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:46,782 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:46,782 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:46,782 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:46,783 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:46,783 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:46,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:46,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:46,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:46,784 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:46,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:46,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,830 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,830 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:46,830 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:46,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:46,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:46,830 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:46,830 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:46,830 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:46,830 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:46,830 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:46,830 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:46,830 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:46,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:46,831 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:46,831 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-08 00:59:46,831 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:46,831 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-08 00:59:46,831 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:46,831 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:46,931 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:46,932 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:46,932 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:46,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:46,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:46,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:46,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:46,939 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:46,939 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:46,940 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:46,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:46,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-08 00:59:46,943 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-08 00:59:46,944 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:46,944 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-08 00:59:46,944 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-08 00:59:46,945 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:46,945 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:47,138 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-02-08 00:59:47,224 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:47,224 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:47,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:47,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:47,225 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:47,225 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:47,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:47,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:47,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:47,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:47,227 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-08 00:59:47,227 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-08 00:59:47,227 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-08 00:59:47,227 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-08 00:59:47,228 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:47,228 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-08 00:59:47,228 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:47,228 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. started... 2023-02-08 00:59:47,228 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:47,228 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:59:47,228 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:47,228 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8c482904a595e426d85ba975310b4bcc 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 00:59:47,228 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:47,229 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. started... 2023-02-08 00:59:47,228 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. started... 2023-02-08 00:59:47,229 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3c9a9a588c7dcedde3924f81c89eb069 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 00:59:47,229 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ede7c7bf0bdac5985188410295f2c926 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-02-08 00:59:47,679 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208b5952846614e489eab3c2e40c2cfa95a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208b5952846614e489eab3c2e40c2cfa95a 2023-02-08 00:59:47,679 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208c83ae8e91f5b463280af0122163f6a4c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230208c83ae8e91f5b463280af0122163f6a4c 2023-02-08 00:59:47,679 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208a5502161ebab4ca1a84cd4f7d2f43da2 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208a5502161ebab4ca1a84cd4f7d2f43da2 2023-02-08 00:59:47,697 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family1/19ed9f46cf364a09b24ec75939fc3885 2023-02-08 00:59:48,094 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family1/d8a6a95a4cc5441f914a4845febb801f 2023-02-08 00:59:48,099 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family1/b235db08585646859ff69b8aeef86c9c 2023-02-08 00:59:48,128 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020892c78a32000e4bf8a4da364b1c9b079b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023020892c78a32000e4bf8a4da364b1c9b079b 2023-02-08 00:59:48,529 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208cb4a282a2b974cdebb32e77143fb909e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230208cb4a282a2b974cdebb32e77143fb909e 2023-02-08 00:59:48,535 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family2/c91ec8c431c84817b1543dfe1bcbcb73 2023-02-08 00:59:48,537 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208678a752940854de6babead551acadae8 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20230208678a752940854de6babead551acadae8 2023-02-08 00:59:48,538 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family1/19ed9f46cf364a09b24ec75939fc3885 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/19ed9f46cf364a09b24ec75939fc3885 2023-02-08 00:59:48,562 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/19ed9f46cf364a09b24ec75939fc3885, entries=4, sequenceid=13, filesize=5.5 K 2023-02-08 00:59:48,563 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family2/c91ec8c431c84817b1543dfe1bcbcb73 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/c91ec8c431c84817b1543dfe1bcbcb73 2023-02-08 00:59:48,566 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/c91ec8c431c84817b1543dfe1bcbcb73, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 00:59:48,567 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 8c482904a595e426d85ba975310b4bcc in 1339ms, sequenceid=13, compaction requested=true 2023-02-08 00:59:48,567 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8c482904a595e426d85ba975310b4bcc: 2023-02-08 00:59:48,567 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:48,567 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:59:48,934 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family2/143b0bcad6fb476ba805bd4b64d3a165 2023-02-08 00:59:48,942 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family2/9960ba77203d4c77afa045f3c9e6c180 2023-02-08 00:59:48,943 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family1/d8a6a95a4cc5441f914a4845febb801f as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/d8a6a95a4cc5441f914a4845febb801f 2023-02-08 00:59:48,948 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family1/b235db08585646859ff69b8aeef86c9c as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/b235db08585646859ff69b8aeef86c9c 2023-02-08 00:59:48,968 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/d8a6a95a4cc5441f914a4845febb801f, entries=4, sequenceid=13, filesize=5.5 K 2023-02-08 00:59:48,968 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family2/143b0bcad6fb476ba805bd4b64d3a165 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/143b0bcad6fb476ba805bd4b64d3a165 2023-02-08 00:59:48,969 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/b235db08585646859ff69b8aeef86c9c, entries=4, sequenceid=13, filesize=5.5 K 2023-02-08 00:59:48,969 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family2/9960ba77203d4c77afa045f3c9e6c180 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/9960ba77203d4c77afa045f3c9e6c180 2023-02-08 00:59:48,972 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/9960ba77203d4c77afa045f3c9e6c180, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 00:59:48,972 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/143b0bcad6fb476ba805bd4b64d3a165, entries=2, sequenceid=13, filesize=5.1 K 2023-02-08 00:59:48,972 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3c9a9a588c7dcedde3924f81c89eb069 in 1743ms, sequenceid=13, compaction requested=true 2023-02-08 00:59:48,972 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ede7c7bf0bdac5985188410295f2c926 in 1743ms, sequenceid=13, compaction requested=true 2023-02-08 00:59:48,973 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3c9a9a588c7dcedde3924f81c89eb069: 2023-02-08 00:59:48,973 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ede7c7bf0bdac5985188410295f2c926: 2023-02-08 00:59:48,973 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:48,973 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:48,973 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:59:48,973 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:59:48,973 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:59:48,973 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:48,973 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-08 00:59:48,973 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-08 00:59:49,277 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:49,277 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:49,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:49,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:49,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:49,277 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:49,277 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:49,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:49,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:49,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:49,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:49,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:49,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-08 00:59:49,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5e1033a9[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:49,279 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-08 00:59:49,279 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:49,292 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:49,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:49,292 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-08 00:59:49,292 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-08 00:59:49,293 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:49,293 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:49,293 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:49,303 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-08 00:59:49,303 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:49,303 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:49,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:49,303 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-08 00:59:49,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:49,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:49,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:49,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:49,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:49,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:49,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:49,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:49,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:49,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:49,307 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-08 00:59:49,307 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-08 00:59:49,307 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:49,307 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:49,308 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-08 00:59:49,308 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:49,557 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:49,557 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:49,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:49,557 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:49,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:49,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:49,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:49,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:49,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:49,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:49,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:49,560 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:49,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:49,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:49,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:49,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:49,564 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:49,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:49,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:49,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:49,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:49,761 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:49,761 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:49,761 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:49,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-08 00:59:49,761 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:49,761 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-08 00:59:49,762 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:49,761 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:49,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:49,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:49,762 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:49,762 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:49,763 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:49,762 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:49,763 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:49,763 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:49,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:49,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:49,763 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:49,863 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:49,863 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:49,863 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:49,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:49,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:49,867 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:49,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(8801): writing data to region testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. with WAL disabled. Data may be lost in the event of a crash. 2023-02-08 00:59:49,871 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:49,871 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:49,872 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:49,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:49,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-08 00:59:49,875 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-08 00:59:49,876 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:49,876 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-08 00:59:49,876 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-08 00:59:49,876 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:49,876 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:50,139 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:50,139 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:50,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:50,140 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:50,140 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:50,142 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:50,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:50,144 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-08 00:59:50,144 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-08 00:59:50,144 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-08 00:59:50,145 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-08 00:59:50,145 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:50,145 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-08 00:59:50,146 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:50,146 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. started... 2023-02-08 00:59:50,146 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:50,146 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:59:50,146 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:50,146 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:50,146 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. started... 2023-02-08 00:59:50,146 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8c482904a595e426d85ba975310b4bcc 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 00:59:50,146 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3c9a9a588c7dcedde3924f81c89eb069 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 00:59:50,146 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. started... 2023-02-08 00:59:50,147 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ede7c7bf0bdac5985188410295f2c926 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-02-08 00:59:50,185 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023020820e05b72a1ca424d893ab8ac1f5cd2ec to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020820e05b72a1ca424d893ab8ac1f5cd2ec 2023-02-08 00:59:50,591 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302088a5457ae23cd4022998db0a99a94a43b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302088a5457ae23cd4022998db0a99a94a43b 2023-02-08 00:59:50,591 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020893da6eb6151d47c493ac3019760c3899 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020893da6eb6151d47c493ac3019760c3899 2023-02-08 00:59:50,598 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family1/60f2fedb718b4600a7dc98379fdf18fb 2023-02-08 00:59:51,005 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family1/55ff50ecd27d46e5b1a47f193301d4e1 2023-02-08 00:59:51,006 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family1/634ac536823a4522b2a5ccc2c82fbb68 2023-02-08 00:59:51,027 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208ee3b6aeadcd0413fa0db85c8b4d70a98 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20230208ee3b6aeadcd0413fa0db85c8b4d70a98 2023-02-08 00:59:51,431 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family2/9020608724a341f5b1bfa525b53df27a 2023-02-08 00:59:51,435 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family1/60f2fedb718b4600a7dc98379fdf18fb as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/60f2fedb718b4600a7dc98379fdf18fb 2023-02-08 00:59:51,441 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202302089e6f0117bad947699bea39ce43b94bcf to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202302089e6f0117bad947699bea39ce43b94bcf 2023-02-08 00:59:51,441 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023020852412f62179d4a9aa960f007c2217d98 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023020852412f62179d4a9aa960f007c2217d98 2023-02-08 00:59:51,467 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/60f2fedb718b4600a7dc98379fdf18fb, entries=4, sequenceid=17, filesize=5.5 K 2023-02-08 00:59:51,468 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family2/9020608724a341f5b1bfa525b53df27a as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/9020608724a341f5b1bfa525b53df27a 2023-02-08 00:59:51,472 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/9020608724a341f5b1bfa525b53df27a, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 00:59:51,472 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ede7c7bf0bdac5985188410295f2c926 in 1325ms, sequenceid=17, compaction requested=true 2023-02-08 00:59:51,472 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ede7c7bf0bdac5985188410295f2c926: 2023-02-08 00:59:51,473 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:51,473 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:59:51,852 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family2/89c1a9e62a364e20aaf171099f426155 2023-02-08 00:59:51,852 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family2/d66e8670d77843858fff47479d52fb92 2023-02-08 00:59:51,857 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family1/634ac536823a4522b2a5ccc2c82fbb68 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/634ac536823a4522b2a5ccc2c82fbb68 2023-02-08 00:59:51,858 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family1/55ff50ecd27d46e5b1a47f193301d4e1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/55ff50ecd27d46e5b1a47f193301d4e1 2023-02-08 00:59:51,882 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/634ac536823a4522b2a5ccc2c82fbb68, entries=4, sequenceid=17, filesize=5.5 K 2023-02-08 00:59:51,883 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family2/d66e8670d77843858fff47479d52fb92 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/d66e8670d77843858fff47479d52fb92 2023-02-08 00:59:51,887 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/55ff50ecd27d46e5b1a47f193301d4e1, entries=4, sequenceid=17, filesize=5.5 K 2023-02-08 00:59:51,887 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family2/89c1a9e62a364e20aaf171099f426155 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/89c1a9e62a364e20aaf171099f426155 2023-02-08 00:59:51,891 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/d66e8670d77843858fff47479d52fb92, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 00:59:51,892 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 8c482904a595e426d85ba975310b4bcc in 1746ms, sequenceid=17, compaction requested=true 2023-02-08 00:59:51,892 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8c482904a595e426d85ba975310b4bcc: 2023-02-08 00:59:51,892 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:51,892 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:59:51,893 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/89c1a9e62a364e20aaf171099f426155, entries=2, sequenceid=17, filesize=5.1 K 2023-02-08 00:59:51,894 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3c9a9a588c7dcedde3924f81c89eb069 in 1748ms, sequenceid=17, compaction requested=true 2023-02-08 00:59:51,894 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3c9a9a588c7dcedde3924f81c89eb069: 2023-02-08 00:59:51,894 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:51,894 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:59:51,894 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:59:51,894 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:51,894 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-08 00:59:51,894 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-08 00:59:52,192 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,192 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:52,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:52,193 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:52,193 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:52,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:52,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:52,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-08 00:59:52,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42807ed[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:52,195 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-08 00:59:52,195 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:52,235 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:52,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:52,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:52,235 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-08 00:59:52,236 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-08 00:59:52,235 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,236 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:52,236 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:52,269 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-08 00:59:52,269 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,269 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:52,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:52,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:52,269 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-08 00:59:52,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:52,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:52,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:52,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:52,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:52,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:52,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-08 00:59:52,272 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-08 00:59:52,272 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:52,272 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:52,272 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-08 00:59:52,272 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:52,308 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:52,308 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:52,308 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:52,308 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:52,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:52,309 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:52,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:52,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:52,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:52,312 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:52,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:52,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,329 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:52,329 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:52,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:52,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:52,329 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,329 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:52,329 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:52,329 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-08 00:59:52,329 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:52,329 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:52,329 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,329 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:52,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:52,329 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:52,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:52,330 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:52,330 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:52,330 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:52,430 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:52,430 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:52,430 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:52,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:52,443 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:59:52,449 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:59:52,456 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 00:59:52,457 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 00:59:52,535 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:52,535 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:52,536 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(933): Client=jenkins//136.243.104.168 procedure request for: flush-table-proc 2023-02-08 00:59:52,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-02-08 00:59:52,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-02-08 00:59:52,538 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-02-08 00:59:52,538 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:52,538 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-02-08 00:59:52,538 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-02-08 00:59:52,538 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:52,538 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:52,835 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:52,835 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,835 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:52,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:52,836 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:52,836 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-02-08 00:59:52,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:52,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:52,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-02-08 00:59:52,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:52,839 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-02-08 00:59:52,840 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-02-08 00:59:52,840 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-02-08 00:59:52,840 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-02-08 00:59:52,840 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-02-08 00:59:52,841 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-02-08 00:59:52,841 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:52,841 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. started... 2023-02-08 00:59:52,841 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-02-08 00:59:52,842 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:52,842 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. started... 2023-02-08 00:59:52,841 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:52,842 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2744): Flushing 3c9a9a588c7dcedde3924f81c89eb069 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 00:59:52,842 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. started... 2023-02-08 00:59:52,842 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2744): Flushing 8c482904a595e426d85ba975310b4bcc 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 00:59:52,842 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-02-08 00:59:52,843 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2744): Flushing ede7c7bf0bdac5985188410295f2c926 2/2 column families, dataSize=138 B heapSize=944 B 2023-02-08 00:59:53,275 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family1/05f632b02f804311aa45dc6650073535 2023-02-08 00:59:53,295 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05f632b02f804311aa45dc6650073535 2023-02-08 00:59:53,677 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family1/6cdfbe5c62e34b5796b639ce0d050276 2023-02-08 00:59:53,679 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family1/d772f94fa130408b99a6c1c6be84e358 2023-02-08 00:59:53,705 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d772f94fa130408b99a6c1c6be84e358 2023-02-08 00:59:53,707 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6cdfbe5c62e34b5796b639ce0d050276 2023-02-08 00:59:54,111 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family2/ebf9fb7b1023459bb3fa1cd39362faff 2023-02-08 00:59:54,121 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebf9fb7b1023459bb3fa1cd39362faff 2023-02-08 00:59:54,122 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family1/05f632b02f804311aa45dc6650073535 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/05f632b02f804311aa45dc6650073535 2023-02-08 00:59:54,143 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05f632b02f804311aa45dc6650073535 2023-02-08 00:59:54,143 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/05f632b02f804311aa45dc6650073535, entries=3, sequenceid=23, filesize=5.2 K 2023-02-08 00:59:54,144 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family2/ebf9fb7b1023459bb3fa1cd39362faff as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/ebf9fb7b1023459bb3fa1cd39362faff 2023-02-08 00:59:54,147 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebf9fb7b1023459bb3fa1cd39362faff 2023-02-08 00:59:54,147 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/ebf9fb7b1023459bb3fa1cd39362faff, entries=1, sequenceid=23, filesize=5.0 K 2023-02-08 00:59:54,148 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3c9a9a588c7dcedde3924f81c89eb069 in 1306ms, sequenceid=23, compaction requested=true 2023-02-08 00:59:54,148 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] regionserver.HRegion(2445): Flush status journal for 3c9a9a588c7dcedde3924f81c89eb069: 2023-02-08 00:59:54,148 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 00:59:54,148 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-02-08 00:59:54,531 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family2/3337011302a24b11a69dc7304ecd44d1 2023-02-08 00:59:54,531 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family2/2f2f3f25c18047c0810232697e69bbd9 2023-02-08 00:59:54,539 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3337011302a24b11a69dc7304ecd44d1 2023-02-08 00:59:54,540 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family1/6cdfbe5c62e34b5796b639ce0d050276 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/6cdfbe5c62e34b5796b639ce0d050276 2023-02-08 00:59:54,540 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f2f3f25c18047c0810232697e69bbd9 2023-02-08 00:59:54,540 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family1/d772f94fa130408b99a6c1c6be84e358 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/d772f94fa130408b99a6c1c6be84e358 2023-02-08 00:59:54,560 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d772f94fa130408b99a6c1c6be84e358 2023-02-08 00:59:54,560 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6cdfbe5c62e34b5796b639ce0d050276 2023-02-08 00:59:54,560 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/d772f94fa130408b99a6c1c6be84e358, entries=3, sequenceid=23, filesize=5.2 K 2023-02-08 00:59:54,560 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/6cdfbe5c62e34b5796b639ce0d050276, entries=3, sequenceid=23, filesize=5.2 K 2023-02-08 00:59:54,560 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family2/2f2f3f25c18047c0810232697e69bbd9 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/2f2f3f25c18047c0810232697e69bbd9 2023-02-08 00:59:54,560 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family2/3337011302a24b11a69dc7304ecd44d1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/3337011302a24b11a69dc7304ecd44d1 2023-02-08 00:59:54,564 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2f2f3f25c18047c0810232697e69bbd9 2023-02-08 00:59:54,564 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3337011302a24b11a69dc7304ecd44d1 2023-02-08 00:59:54,564 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/2f2f3f25c18047c0810232697e69bbd9, entries=1, sequenceid=23, filesize=5.0 K 2023-02-08 00:59:54,564 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/3337011302a24b11a69dc7304ecd44d1, entries=1, sequenceid=23, filesize=5.0 K 2023-02-08 00:59:54,565 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ede7c7bf0bdac5985188410295f2c926 in 1722ms, sequenceid=23, compaction requested=true 2023-02-08 00:59:54,565 INFO [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2947): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 8c482904a595e426d85ba975310b4bcc in 1723ms, sequenceid=23, compaction requested=true 2023-02-08 00:59:54,565 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] regionserver.HRegion(2445): Flush status journal for ede7c7bf0bdac5985188410295f2c926: 2023-02-08 00:59:54,565 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] regionserver.HRegion(2445): Flush status journal for 8c482904a595e426d85ba975310b4bcc: 2023-02-08 00:59:54,565 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:54,565 DEBUG [rs(jenkins-hbase12.apache.org,36907,1675817727419)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:54,565 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-02-08 00:59:54,565 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-02-08 00:59:54,565 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-02-08 00:59:54,565 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:54,565 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-02-08 00:59:54,565 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-02-08 00:59:54,866 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:54,866 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:54,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:54,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:54,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:54,867 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:54,867 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-02-08 00:59:54,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:54,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:54,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:54,870 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase12.apache.org,36907,1675817727419' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-02-08 00:59:54,871 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6203d4e9[Count = 0] remaining members to acquire global barrier 2023-02-08 00:59:54,871 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-02-08 00:59:54,871 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:54,920 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:54,920 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:54,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:54,920 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-02-08 00:59:54,921 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-02-08 00:59:54,921 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase12.apache.org,36907,1675817727419' in zk 2023-02-08 00:59:54,921 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:54,921 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-02-08 00:59:54,939 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-02-08 00:59:54,939 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:54,940 DEBUG [member: 'jenkins-hbase12.apache.org,36907,1675817727419' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-02-08 00:59:54,939 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:54,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:54,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:54,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:54,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:54,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:54,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:54,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:54,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:54,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:54,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:54,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase12.apache.org,36907,1675817727419': 2023-02-08 00:59:54,943 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase12.apache.org,36907,1675817727419' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-02-08 00:59:54,943 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-02-08 00:59:54,943 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-02-08 00:59:54,943 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-02-08 00:59:54,943 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-02-08 00:59:54,943 INFO [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-02-08 00:59:54,960 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:54,960 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-02-08 00:59:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-02-08 00:59:54,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:54,960 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:54,961 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-02-08 00:59:54,961 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:54,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:54,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-02-08 00:59:54,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:54,962 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:54,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:54,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-02-08 00:59:54,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-02-08 00:59:54,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:55,261 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:55,261 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-02-08 00:59:55,261 DEBUG [(jenkins-hbase12.apache.org,36763,1675817725340)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-02-08 00:59:55,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-02-08 00:59:55,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-02-08 00:59:55,261 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-02-08 00:59:55,261 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:55,261 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-02-08 00:59:55,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-02-08 00:59:55,263 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-02-08 00:59:55,262 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-02-08 00:59:55,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-02-08 00:59:55,263 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 00:59:55,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-02-08 00:59:55,264 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:55,264 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-02-08 00:59:55,264 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-02-08 00:59:55,265 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-02-08 00:59:55,264 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-02-08 00:59:55,365 DEBUG [Listener at localhost.localdomain/36213] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-02-08 00:59:55,366 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 00:59:55,366 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 00:59:55,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=36763] master.MasterRpcServices(1186): Checking to see if procedure from request:flush-table-proc is done 2023-02-08 00:59:55,367 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:59:55,368 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): 8c482904a595e426d85ba975310b4bcc/family1 is initiating major compaction (all files) 2023-02-08 00:59:55,368 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:59:55,368 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:59:55,370 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of 8c482904a595e426d85ba975310b4bcc/family1 in testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:55,370 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/6f373ab6c4a74dc9b4b46b4c60b18f8c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/9cda0c4ed7f04614b7af8cff0882031c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/19ed9f46cf364a09b24ec75939fc3885, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/634ac536823a4522b2a5ccc2c82fbb68, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/d772f94fa130408b99a6c1c6be84e358] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp, totalSize=27.1 K 2023-02-08 00:59:55,371 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 6f373ab6c4a74dc9b4b46b4c60b18f8c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817982264 2023-02-08 00:59:55,372 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 9cda0c4ed7f04614b7af8cff0882031c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817984615 2023-02-08 00:59:55,373 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 19ed9f46cf364a09b24ec75939fc3885, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817986935 2023-02-08 00:59:55,374 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 634ac536823a4522b2a5ccc2c82fbb68, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817989867 2023-02-08 00:59:55,375 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting d772f94fa130408b99a6c1c6be84e358, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 00:59:55,386 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): 8c482904a595e426d85ba975310b4bcc#family1#compaction#198 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:59:55,835 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230208effa3239f48f452cb1bc54cb225e9827_del 2023-02-08 00:59:55,835 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208effa3239f48f452cb1bc54cb225e9827_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230208effa3239f48f452cb1bc54cb225e9827_del 2023-02-08 00:59:56,698 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75d74c85e3714228ad087dc660b145b9 2023-02-08 00:59:56,699 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family1/75d74c85e3714228ad087dc660b145b9 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/75d74c85e3714228ad087dc660b145b9 2023-02-08 00:59:56,720 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 75d74c85e3714228ad087dc660b145b9 2023-02-08 00:59:56,721 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8c482904a595e426d85ba975310b4bcc/family1 of 8c482904a595e426d85ba975310b4bcc into 75d74c85e3714228ad087dc660b145b9(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:59:56,722 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for 8c482904a595e426d85ba975310b4bcc: 2023-02-08 00:59:56,722 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:59:56,722 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): 8c482904a595e426d85ba975310b4bcc/family2 is initiating major compaction (all files) 2023-02-08 00:59:56,722 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:59:56,722 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:59:56,722 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of 8c482904a595e426d85ba975310b4bcc/family2 in testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 00:59:56,722 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/bd41cb43be3c463dac48e07df793cb1f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/5202461b8c224a92938f36f9cbdae500, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/c91ec8c431c84817b1543dfe1bcbcb73, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/d66e8670d77843858fff47479d52fb92, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/2f2f3f25c18047c0810232697e69bbd9] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp, totalSize=25.4 K 2023-02-08 00:59:56,723 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting bd41cb43be3c463dac48e07df793cb1f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817982264 2023-02-08 00:59:56,723 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 5202461b8c224a92938f36f9cbdae500, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817984615 2023-02-08 00:59:56,723 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting c91ec8c431c84817b1543dfe1bcbcb73, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817986935 2023-02-08 00:59:56,723 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting d66e8670d77843858fff47479d52fb92, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817989867 2023-02-08 00:59:56,724 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 2f2f3f25c18047c0810232697e69bbd9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 00:59:56,731 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): 8c482904a595e426d85ba975310b4bcc#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:59:56,797 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/6f373ab6c4a74dc9b4b46b4c60b18f8c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/9cda0c4ed7f04614b7af8cff0882031c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/19ed9f46cf364a09b24ec75939fc3885, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/634ac536823a4522b2a5ccc2c82fbb68, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/d772f94fa130408b99a6c1c6be84e358] to archive 2023-02-08 00:59:56,798 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:56,800 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/6f373ab6c4a74dc9b4b46b4c60b18f8c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/6f373ab6c4a74dc9b4b46b4c60b18f8c 2023-02-08 00:59:56,801 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/9cda0c4ed7f04614b7af8cff0882031c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/9cda0c4ed7f04614b7af8cff0882031c 2023-02-08 00:59:56,803 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/19ed9f46cf364a09b24ec75939fc3885 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/19ed9f46cf364a09b24ec75939fc3885 2023-02-08 00:59:56,804 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/634ac536823a4522b2a5ccc2c82fbb68 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/634ac536823a4522b2a5ccc2c82fbb68 2023-02-08 00:59:56,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/d772f94fa130408b99a6c1c6be84e358 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/d772f94fa130408b99a6c1c6be84e358 2023-02-08 00:59:57,139 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230208f54cb1e158574d5a8629a415e176f112_del 2023-02-08 00:59:57,140 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230208f54cb1e158574d5a8629a415e176f112_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20230208f54cb1e158574d5a8629a415e176f112_del 2023-02-08 00:59:57,952 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0cf40b576cf438aa5d82c2841b71359 2023-02-08 00:59:57,953 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/.tmp/family2/c0cf40b576cf438aa5d82c2841b71359 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/c0cf40b576cf438aa5d82c2841b71359 2023-02-08 00:59:57,955 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c0cf40b576cf438aa5d82c2841b71359 2023-02-08 00:59:57,956 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 8c482904a595e426d85ba975310b4bcc/family2 of 8c482904a595e426d85ba975310b4bcc into c0cf40b576cf438aa5d82c2841b71359(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:59:57,956 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for 8c482904a595e426d85ba975310b4bcc: 2023-02-08 00:59:57,956 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:59:57,956 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): ede7c7bf0bdac5985188410295f2c926/family1 is initiating major compaction (all files) 2023-02-08 00:59:57,957 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:59:57,957 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:59:57,957 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of ede7c7bf0bdac5985188410295f2c926/family1 in testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:57,957 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/6d6a9ef3103d42b58a8fa60247c5bfff, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/7c07109bd90e4ac7b2fc221fcde79714, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/d8a6a95a4cc5441f914a4845febb801f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/60f2fedb718b4600a7dc98379fdf18fb, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/6cdfbe5c62e34b5796b639ce0d050276] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp, totalSize=27.1 K 2023-02-08 00:59:57,957 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 6d6a9ef3103d42b58a8fa60247c5bfff, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817982264 2023-02-08 00:59:57,958 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 7c07109bd90e4ac7b2fc221fcde79714, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817984614 2023-02-08 00:59:57,958 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting d8a6a95a4cc5441f914a4845febb801f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817986935 2023-02-08 00:59:57,958 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 60f2fedb718b4600a7dc98379fdf18fb, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817989867 2023-02-08 00:59:57,958 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 6cdfbe5c62e34b5796b639ce0d050276, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 00:59:57,966 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): ede7c7bf0bdac5985188410295f2c926#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:59:57,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/bd41cb43be3c463dac48e07df793cb1f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/5202461b8c224a92938f36f9cbdae500, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/c91ec8c431c84817b1543dfe1bcbcb73, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/d66e8670d77843858fff47479d52fb92, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/2f2f3f25c18047c0810232697e69bbd9] to archive 2023-02-08 00:59:57,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:57,997 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/bd41cb43be3c463dac48e07df793cb1f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/bd41cb43be3c463dac48e07df793cb1f 2023-02-08 00:59:57,998 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/5202461b8c224a92938f36f9cbdae500 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/5202461b8c224a92938f36f9cbdae500 2023-02-08 00:59:57,999 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/c91ec8c431c84817b1543dfe1bcbcb73 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/c91ec8c431c84817b1543dfe1bcbcb73 2023-02-08 00:59:58,000 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/d66e8670d77843858fff47479d52fb92 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/d66e8670d77843858fff47479d52fb92 2023-02-08 00:59:58,001 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/2f2f3f25c18047c0810232697e69bbd9 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family2/2f2f3f25c18047c0810232697e69bbd9 2023-02-08 00:59:58,402 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230208301ea3fa91b349b6a96954bf8dd1b184_del 2023-02-08 00:59:58,402 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208301ea3fa91b349b6a96954bf8dd1b184_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208301ea3fa91b349b6a96954bf8dd1b184_del 2023-02-08 00:59:59,250 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4025a39f4594134823c8e7bf0a05924 2023-02-08 00:59:59,251 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family1/e4025a39f4594134823c8e7bf0a05924 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/e4025a39f4594134823c8e7bf0a05924 2023-02-08 00:59:59,281 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e4025a39f4594134823c8e7bf0a05924 2023-02-08 00:59:59,282 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ede7c7bf0bdac5985188410295f2c926/family1 of ede7c7bf0bdac5985188410295f2c926 into e4025a39f4594134823c8e7bf0a05924(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 00:59:59,283 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for ede7c7bf0bdac5985188410295f2c926: 2023-02-08 00:59:59,283 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 00:59:59,283 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): ede7c7bf0bdac5985188410295f2c926/family2 is initiating major compaction (all files) 2023-02-08 00:59:59,283 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 00:59:59,283 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 00:59:59,285 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of ede7c7bf0bdac5985188410295f2c926/family2 in testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 00:59:59,285 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/dd1e5320ca0c4f49a2cbe3248ae6ab30, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/ba954ed31efc4867968956289ee92ee2, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/143b0bcad6fb476ba805bd4b64d3a165, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/9020608724a341f5b1bfa525b53df27a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/3337011302a24b11a69dc7304ecd44d1] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp, totalSize=25.4 K 2023-02-08 00:59:59,286 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting dd1e5320ca0c4f49a2cbe3248ae6ab30, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817982264 2023-02-08 00:59:59,286 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting ba954ed31efc4867968956289ee92ee2, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817984614 2023-02-08 00:59:59,287 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 143b0bcad6fb476ba805bd4b64d3a165, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817986935 2023-02-08 00:59:59,287 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 9020608724a341f5b1bfa525b53df27a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817989867 2023-02-08 00:59:59,287 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 3337011302a24b11a69dc7304ecd44d1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 00:59:59,293 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/6d6a9ef3103d42b58a8fa60247c5bfff, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/7c07109bd90e4ac7b2fc221fcde79714, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/d8a6a95a4cc5441f914a4845febb801f, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/60f2fedb718b4600a7dc98379fdf18fb, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/6cdfbe5c62e34b5796b639ce0d050276] to archive 2023-02-08 00:59:59,294 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 00:59:59,295 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/6d6a9ef3103d42b58a8fa60247c5bfff to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/6d6a9ef3103d42b58a8fa60247c5bfff 2023-02-08 00:59:59,295 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): ede7c7bf0bdac5985188410295f2c926#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 00:59:59,296 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/7c07109bd90e4ac7b2fc221fcde79714 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/7c07109bd90e4ac7b2fc221fcde79714 2023-02-08 00:59:59,298 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/d8a6a95a4cc5441f914a4845febb801f to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/d8a6a95a4cc5441f914a4845febb801f 2023-02-08 00:59:59,299 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/60f2fedb718b4600a7dc98379fdf18fb to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/60f2fedb718b4600a7dc98379fdf18fb 2023-02-08 00:59:59,300 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/6cdfbe5c62e34b5796b639ce0d050276 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/6cdfbe5c62e34b5796b639ce0d050276 2023-02-08 00:59:59,895 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202302084751978f4a5549a489e75533b33dd8b5_del 2023-02-08 00:59:59,895 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202302084751978f4a5549a489e75533b33dd8b5_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202302084751978f4a5549a489e75533b33dd8b5_del 2023-02-08 01:00:00,309 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 32abea062cdd494389701a7deb62651e 2023-02-08 01:00:00,310 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/.tmp/family2/32abea062cdd494389701a7deb62651e as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/32abea062cdd494389701a7deb62651e 2023-02-08 01:00:00,314 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 32abea062cdd494389701a7deb62651e 2023-02-08 01:00:00,315 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ede7c7bf0bdac5985188410295f2c926/family2 of ede7c7bf0bdac5985188410295f2c926 into 32abea062cdd494389701a7deb62651e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 01:00:00,316 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for ede7c7bf0bdac5985188410295f2c926: 2023-02-08 01:00:00,316 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 01:00:00,316 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): 3c9a9a588c7dcedde3924f81c89eb069/family1 is initiating major compaction (all files) 2023-02-08 01:00:00,316 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 01:00:00,316 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 01:00:00,317 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of 3c9a9a588c7dcedde3924f81c89eb069/family1 in testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 01:00:00,317 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/4a64253155894613b5d7c0d3bf7563bc, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/5e51f9ae29b24e5d8cbfbe2cd6930509, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/b235db08585646859ff69b8aeef86c9c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/55ff50ecd27d46e5b1a47f193301d4e1, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/05f632b02f804311aa45dc6650073535] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp, totalSize=27.1 K 2023-02-08 01:00:00,318 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 4a64253155894613b5d7c0d3bf7563bc, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817982265 2023-02-08 01:00:00,319 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 5e51f9ae29b24e5d8cbfbe2cd6930509, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817984615 2023-02-08 01:00:00,319 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting b235db08585646859ff69b8aeef86c9c, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817986935 2023-02-08 01:00:00,320 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 55ff50ecd27d46e5b1a47f193301d4e1, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817989868 2023-02-08 01:00:00,321 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 05f632b02f804311aa45dc6650073535, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 01:00:00,335 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): 3c9a9a588c7dcedde3924f81c89eb069#family1#compaction#202 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 01:00:00,397 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/dd1e5320ca0c4f49a2cbe3248ae6ab30, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/ba954ed31efc4867968956289ee92ee2, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/143b0bcad6fb476ba805bd4b64d3a165, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/9020608724a341f5b1bfa525b53df27a, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/3337011302a24b11a69dc7304ecd44d1] to archive 2023-02-08 01:00:00,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 01:00:00,400 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/dd1e5320ca0c4f49a2cbe3248ae6ab30 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/dd1e5320ca0c4f49a2cbe3248ae6ab30 2023-02-08 01:00:00,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/ba954ed31efc4867968956289ee92ee2 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/ba954ed31efc4867968956289ee92ee2 2023-02-08 01:00:00,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/143b0bcad6fb476ba805bd4b64d3a165 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/143b0bcad6fb476ba805bd4b64d3a165 2023-02-08 01:00:00,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/9020608724a341f5b1bfa525b53df27a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/9020608724a341f5b1bfa525b53df27a 2023-02-08 01:00:00,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/3337011302a24b11a69dc7304ecd44d1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family2/3337011302a24b11a69dc7304ecd44d1 2023-02-08 01:00:00,780 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230208549e175c2611426597389902806d81cd_del 2023-02-08 01:00:00,780 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20230208549e175c2611426597389902806d81cd_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208549e175c2611426597389902806d81cd_del 2023-02-08 01:00:01,624 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 746e764522af4603914a3f201b807fea 2023-02-08 01:00:01,625 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family1/746e764522af4603914a3f201b807fea as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/746e764522af4603914a3f201b807fea 2023-02-08 01:00:01,642 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 746e764522af4603914a3f201b807fea 2023-02-08 01:00:01,643 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3c9a9a588c7dcedde3924f81c89eb069/family1 of 3c9a9a588c7dcedde3924f81c89eb069 into 746e764522af4603914a3f201b807fea(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 01:00:01,643 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for 3c9a9a588c7dcedde3924f81c89eb069: 2023-02-08 01:00:01,643 DEBUG [Listener at localhost.localdomain/36213] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-02-08 01:00:01,643 DEBUG [Listener at localhost.localdomain/36213] regionserver.HStore(1912): 3c9a9a588c7dcedde3924f81c89eb069/family2 is initiating major compaction (all files) 2023-02-08 01:00:01,643 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-02-08 01:00:01,643 INFO [Listener at localhost.localdomain/36213] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-02-08 01:00:01,643 INFO [Listener at localhost.localdomain/36213] regionserver.HRegion(2258): Starting compaction of 3c9a9a588c7dcedde3924f81c89eb069/family2 in testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 01:00:01,643 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1468): Starting compaction of [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/fd74f3534bb645a6aff947f36c9b1772, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/49d80eaa5c0a43a99432cee5610b4003, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/9960ba77203d4c77afa045f3c9e6c180, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/89c1a9e62a364e20aaf171099f426155, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/ebf9fb7b1023459bb3fa1cd39362faff] into tmpdir=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp, totalSize=25.4 K 2023-02-08 01:00:01,644 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting fd74f3534bb645a6aff947f36c9b1772, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1675817982265 2023-02-08 01:00:01,644 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 49d80eaa5c0a43a99432cee5610b4003, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1675817984615 2023-02-08 01:00:01,644 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 9960ba77203d4c77afa045f3c9e6c180, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1675817986935 2023-02-08 01:00:01,645 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting 89c1a9e62a364e20aaf171099f426155, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1675817989868 2023-02-08 01:00:01,645 DEBUG [Listener at localhost.localdomain/36213] compactions.Compactor(207): Compacting ebf9fb7b1023459bb3fa1cd39362faff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-02-08 01:00:01,652 INFO [Listener at localhost.localdomain/36213] throttle.PressureAwareThroughputController(145): 3c9a9a588c7dcedde3924f81c89eb069#family2#compaction#203 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-02-08 01:00:01,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/4a64253155894613b5d7c0d3bf7563bc, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/5e51f9ae29b24e5d8cbfbe2cd6930509, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/b235db08585646859ff69b8aeef86c9c, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/55ff50ecd27d46e5b1a47f193301d4e1, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/05f632b02f804311aa45dc6650073535] to archive 2023-02-08 01:00:01,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 01:00:01,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/4a64253155894613b5d7c0d3bf7563bc to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/4a64253155894613b5d7c0d3bf7563bc 2023-02-08 01:00:01,700 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/5e51f9ae29b24e5d8cbfbe2cd6930509 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/5e51f9ae29b24e5d8cbfbe2cd6930509 2023-02-08 01:00:01,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/b235db08585646859ff69b8aeef86c9c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/b235db08585646859ff69b8aeef86c9c 2023-02-08 01:00:01,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/55ff50ecd27d46e5b1a47f193301d4e1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/55ff50ecd27d46e5b1a47f193301d4e1 2023-02-08 01:00:01,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/05f632b02f804311aa45dc6650073535 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/05f632b02f804311aa45dc6650073535 2023-02-08 01:00:02,059 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023020827e53d37131f452c90e4135c0bf5324e_del 2023-02-08 01:00:02,059 INFO [Listener at localhost.localdomain/36213] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020827e53d37131f452c90e4135c0bf5324e_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023020827e53d37131f452c90e4135c0bf5324e_del 2023-02-08 01:00:02,870 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b07b28fe9c3a46c5a2b4d82b4ea8e636 2023-02-08 01:00:02,871 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/.tmp/family2/b07b28fe9c3a46c5a2b4d82b4ea8e636 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/b07b28fe9c3a46c5a2b4d82b4ea8e636 2023-02-08 01:00:02,874 INFO [Listener at localhost.localdomain/36213] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b07b28fe9c3a46c5a2b4d82b4ea8e636 2023-02-08 01:00:02,875 INFO [Listener at localhost.localdomain/36213] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3c9a9a588c7dcedde3924f81c89eb069/family2 of 3c9a9a588c7dcedde3924f81c89eb069 into b07b28fe9c3a46c5a2b4d82b4ea8e636(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-02-08 01:00:02,875 DEBUG [Listener at localhost.localdomain/36213] regionserver.HRegion(2288): Compaction status journal for 3c9a9a588c7dcedde3924f81c89eb069: 2023-02-08 01:00:02,878 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 01:00:02,881 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 01:00:02,884 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 01:00:02,885 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 01:00:02,889 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=36763] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x89G9\xB4@/\xFC\xABc\x8D)\xED&\xC4\x15\xDC"\x10`\xAB\x84\xA7#\x0FS\x9F)jk\xC3\xBC\x9COq*\x10pY\x8Ep\x8BD&\xEF\x9FFGp\xB8\xF7\xE0\xC22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-02-08 01:00:02,893 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/fd74f3534bb645a6aff947f36c9b1772, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/49d80eaa5c0a43a99432cee5610b4003, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/9960ba77203d4c77afa045f3c9e6c180, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/89c1a9e62a364e20aaf171099f426155, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/ebf9fb7b1023459bb3fa1cd39362faff] to archive 2023-02-08 01:00:02,894 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 01:00:02,895 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/fd74f3534bb645a6aff947f36c9b1772 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/fd74f3534bb645a6aff947f36c9b1772 2023-02-08 01:00:02,896 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/49d80eaa5c0a43a99432cee5610b4003 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/49d80eaa5c0a43a99432cee5610b4003 2023-02-08 01:00:02,897 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/9960ba77203d4c77afa045f3c9e6c180 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/9960ba77203d4c77afa045f3c9e6c180 2023-02-08 01:00:02,898 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/89c1a9e62a364e20aaf171099f426155 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/89c1a9e62a364e20aaf171099f426155 2023-02-08 01:00:02,899 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase12:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/ebf9fb7b1023459bb3fa1cd39362faff to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family2/ebf9fb7b1023459bb3fa1cd39362faff 2023-02-08 01:00:02,907 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] procedure2.ProcedureExecutor(1029): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-08 01:00:02,908 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-08 01:00:02,908 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 01:00:02,908 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1675818602908 2023-02-08 01:00:02,909 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-02-08 01:00:03,201 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-02-08 01:00:03,219 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20230208301ea3fa91b349b6a96954bf8dd1b184_del 2023-02-08 01:00:03,237 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20230208effa3239f48f452cb1bc54cb225e9827_del 2023-02-08 01:00:03,256 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20230208549e175c2611426597389902806d81cd_del 2023-02-08 01:00:03,256 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 01:00:03,256 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] zookeeper.ReadOnlyZKClient(139): Connect 0x5d269eb3 to 127.0.0.1:49726 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-02-08 01:00:03,434 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ae5a60a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-02-08 01:00:03,434 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20230208 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-08 01:00:03,979 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230208388fa3b4757b4a5388bf30e59eb57ca7 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208388fa3b4757b4a5388bf30e59eb57ca7 2023-02-08 01:00:03,980 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 01:00:03,989 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-02-08 01:00:03,991 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:42746, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-02-08 01:00:03,998 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 01:00:03,998 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 01:00:03,999 DEBUG [MobCompactor-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-02-08 01:00:04,001 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 136.243.104.168:50734, version=2.4.17-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-02-08 01:00:04,026 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230208/family1/3794b7d55c0145c1a9eb97a448b663fb first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-02-08 01:00:04,027 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230208/family1/3794b7d55c0145c1a9eb97a448b663fb}] 2023-02-08 01:00:04,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230208/family1/3794b7d55c0145c1a9eb97a448b663fb for inclusion in ede7c7bf0bdac5985188410295f2c926/family1 2023-02-08 01:00:04,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-02-08 01:00:04,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first= last=1 2023-02-08 01:00:04,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for ede7c7bf0bdac5985188410295f2c926: 2023-02-08 01:00:04,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230208/family1/3794b7d55c0145c1a9eb97a448b663fb to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__qu0k1ejm1nn77c8tgfgc9e94tcie959890e2ujdristgmve1esdn85v6qm8r5muk/family1/3794b7d55c0145c1a9eb97a448b663fb 2023-02-08 01:00:04,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__qu0k1ejm1nn77c8tgfgc9e94tcie959890e2ujdristgmve1esdn85v6qm8r5muk/family1/3794b7d55c0145c1a9eb97a448b663fb as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/428b6435a7954c9b93e57700a87b8ca6_SeqId_28_ 2023-02-08 01:00:04,053 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__qu0k1ejm1nn77c8tgfgc9e94tcie959890e2ujdristgmve1esdn85v6qm8r5muk/family1/3794b7d55c0145c1a9eb97a448b663fb into ede7c7bf0bdac5985188410295f2c926/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/428b6435a7954c9b93e57700a87b8ca6_SeqId_28_ - updating store file list. 2023-02-08 01:00:04,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/428b6435a7954c9b93e57700a87b8ca6_SeqId_28_ into ede7c7bf0bdac5985188410295f2c926/family1 2023-02-08 01:00:04,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__qu0k1ejm1nn77c8tgfgc9e94tcie959890e2ujdristgmve1esdn85v6qm8r5muk/family1/3794b7d55c0145c1a9eb97a448b663fb into ede7c7bf0bdac5985188410295f2c926/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/family1/428b6435a7954c9b93e57700a87b8ca6_SeqId_28_) 2023-02-08 01:00:04,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__qu0k1ejm1nn77c8tgfgc9e94tcie959890e2ujdristgmve1esdn85v6qm8r5muk/family1/3794b7d55c0145c1a9eb97a448b663fb 2023-02-08 01:00:04,094 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20230208 table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 01:00:04,095 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 01:00:04,096 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020820e05b72a1ca424d893ab8ac1f5cd2ec to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020820e05b72a1ca424d893ab8ac1f5cd2ec 2023-02-08 01:00:04,097 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020829f52463fb084edaae2fc2c3f3809471 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023020829f52463fb084edaae2fc2c3f3809471 2023-02-08 01:00:04,098 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208aa5af1f75cd94aa7b78f176df9a52b07 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208aa5af1f75cd94aa7b78f176df9a52b07 2023-02-08 01:00:04,098 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208b5952846614e489eab3c2e40c2cfa95a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208b5952846614e489eab3c2e40c2cfa95a 2023-02-08 01:00:04,098 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-08 01:00:04,098 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20230208' 2023-02-08 01:00:04,099 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20230208 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-08 01:00:04,099 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20230208 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-08 01:00:05,047 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202302083a61cbfc706446c2a43a0b0052996b91 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202302083a61cbfc706446c2a43a0b0052996b91 2023-02-08 01:00:05,048 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 01:00:05,060 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 01:00:05,060 INFO [MobCompactor-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 01:00:05,082 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230208/family1/ce3b18a11fe84fd886ca6629b07e1cbc first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-02-08 01:00:05,082 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230208/family1/ce3b18a11fe84fd886ca6629b07e1cbc}] 2023-02-08 01:00:05,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230208/family1/ce3b18a11fe84fd886ca6629b07e1cbc for inclusion in 8c482904a595e426d85ba975310b4bcc/family1 2023-02-08 01:00:05,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-02-08 01:00:05,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=1 last=2 2023-02-08 01:00:05,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 8c482904a595e426d85ba975310b4bcc: 2023-02-08 01:00:05,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230208/family1/ce3b18a11fe84fd886ca6629b07e1cbc to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__7rond55rvt6to0ga2t1gp4r0cfr4s2odj9fo8h2jpb0bv1n5v1d6p4gu22kuf3ij/family1/ce3b18a11fe84fd886ca6629b07e1cbc 2023-02-08 01:00:05,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__7rond55rvt6to0ga2t1gp4r0cfr4s2odj9fo8h2jpb0bv1n5v1d6p4gu22kuf3ij/family1/ce3b18a11fe84fd886ca6629b07e1cbc as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/95e661408e0a4cc284f7cb8f0a5b0135_SeqId_28_ 2023-02-08 01:00:05,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__7rond55rvt6to0ga2t1gp4r0cfr4s2odj9fo8h2jpb0bv1n5v1d6p4gu22kuf3ij/family1/ce3b18a11fe84fd886ca6629b07e1cbc into 8c482904a595e426d85ba975310b4bcc/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/95e661408e0a4cc284f7cb8f0a5b0135_SeqId_28_ - updating store file list. 2023-02-08 01:00:05,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/95e661408e0a4cc284f7cb8f0a5b0135_SeqId_28_ into 8c482904a595e426d85ba975310b4bcc/family1 2023-02-08 01:00:05,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__7rond55rvt6to0ga2t1gp4r0cfr4s2odj9fo8h2jpb0bv1n5v1d6p4gu22kuf3ij/family1/ce3b18a11fe84fd886ca6629b07e1cbc into 8c482904a595e426d85ba975310b4bcc/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/family1/95e661408e0a4cc284f7cb8f0a5b0135_SeqId_28_) 2023-02-08 01:00:05,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__7rond55rvt6to0ga2t1gp4r0cfr4s2odj9fo8h2jpb0bv1n5v1d6p4gu22kuf3ij/family1/ce3b18a11fe84fd886ca6629b07e1cbc 2023-02-08 01:00:05,122 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20230208 table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 01:00:05,123 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 01:00:05,124 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020811f9fe8de99d4738a201e2b4aa161107 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020811f9fe8de99d4738a201e2b4aa161107 2023-02-08 01:00:05,124 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020893da6eb6151d47c493ac3019760c3899 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023020893da6eb6151d47c493ac3019760c3899 2023-02-08 01:00:05,125 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230208947ed1d089a749f089a7623820bae44a to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230208947ed1d089a749f089a7623820bae44a 2023-02-08 01:00:05,125 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230208c83ae8e91f5b463280af0122163f6a4c to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230208c83ae8e91f5b463280af0122163f6a4c 2023-02-08 01:00:05,126 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-08 01:00:05,126 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20230208' 2023-02-08 01:00:05,126 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20230208 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-08 01:00:05,126 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20230208 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-08 01:00:06,056 INFO [MobCompactor-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023020892ddc2a69ef14e74ac9b02440c3c7e7b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023020892ddc2a69ef14e74ac9b02440c3c7e7b 2023-02-08 01:00:06,057 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 01:00:06,075 INFO [MobCompactor-pool-1] client.ConnectionImplementation(1944): Getting master connection state from TTL Cache 2023-02-08 01:00:06,075 INFO [MobCompactor-pool-1] client.ConnectionImplementation(403): Getting master state using rpc call 2023-02-08 01:00:06,098 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(787): Trying to load hfile=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230208/family1/97eb8e84edda4240be8ee87d90151dc1 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-02-08 01:00:06,099 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(552): Going to connect to server region=testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069., hostname=jenkins-hbase12.apache.org,36907,1675817727419, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230208/family1/97eb8e84edda4240be8ee87d90151dc1}] 2023-02-08 01:00:06,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(763): Validating hfile at hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230208/family1/97eb8e84edda4240be8ee87d90151dc1 for inclusion in 3c9a9a588c7dcedde3924f81c89eb069/family1 2023-02-08 01:00:06,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-02-08 01:00:06,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(777): Region bounds: first=2 last= 2023-02-08 01:00:06,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegion(2445): Flush status journal for 3c9a9a588c7dcedde3924f81c89eb069: 2023-02-08 01:00:06,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230208/family1/97eb8e84edda4240be8ee87d90151dc1 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__us0l29epdfo85kn236grr3bmtr6hobsgl1nebpg8sg7deskrvtm27lmg72hd2mod/family1/97eb8e84edda4240be8ee87d90151dc1 2023-02-08 01:00:06,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__us0l29epdfo85kn236grr3bmtr6hobsgl1nebpg8sg7deskrvtm27lmg72hd2mod/family1/97eb8e84edda4240be8ee87d90151dc1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/6ff5e4a9fee64a8ea8b272268cd3843f_SeqId_28_ 2023-02-08 01:00:06,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(849): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__us0l29epdfo85kn236grr3bmtr6hobsgl1nebpg8sg7deskrvtm27lmg72hd2mod/family1/97eb8e84edda4240be8ee87d90151dc1 into 3c9a9a588c7dcedde3924f81c89eb069/family1 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/6ff5e4a9fee64a8ea8b272268cd3843f_SeqId_28_ - updating store file list. 2023-02-08 01:00:06,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(882): Loaded HFile hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/6ff5e4a9fee64a8ea8b272268cd3843f_SeqId_28_ into 3c9a9a588c7dcedde3924f81c89eb069/family1 2023-02-08 01:00:06,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.HStore(855): Successfully loaded hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__us0l29epdfo85kn236grr3bmtr6hobsgl1nebpg8sg7deskrvtm27lmg72hd2mod/family1/97eb8e84edda4240be8ee87d90151dc1 into 3c9a9a588c7dcedde3924f81c89eb069/family1 (new location: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/family1/6ff5e4a9fee64a8ea8b272268cd3843f_SeqId_28_) 2023-02-08 01:00:06,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36907] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/staging/jenkins__testMajorCompactionFromAdmin__us0l29epdfo85kn236grr3bmtr6hobsgl1nebpg8sg7deskrvtm27lmg72hd2mod/family1/97eb8e84edda4240be8ee87d90151dc1 2023-02-08 01:00:06,151 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20230208 table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 01:00:06,152 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 01:00:06,153 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208531efc5f9628424fbb2a4745114da7a2 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208531efc5f9628424fbb2a4745114da7a2 2023-02-08 01:00:06,153 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208596ced569c3e4955b16206c2d26bc33e to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208596ced569c3e4955b16206c2d26bc33e 2023-02-08 01:00:06,154 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302088a5457ae23cd4022998db0a99a94a43b to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202302088a5457ae23cd4022998db0a99a94a43b 2023-02-08 01:00:06,155 DEBUG [MobCompactor-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208a5502161ebab4ca1a84cd4f7d2f43da2 to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208a5502161ebab4ca1a84cd4f7d2f43da2 2023-02-08 01:00:06,155 INFO [MobCompactor-pool-1] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-02-08 01:00:06,155 DEBUG [MobCompactor-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20230208' 2023-02-08 01:00:06,155 INFO [MobCompactor-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20230208 for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-08 01:00:06,155 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-02-08 01:00:06,155 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-02-08 01:00:06,155 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208301ea3fa91b349b6a96954bf8dd1b184_del] 2023-02-08 01:00:06,155 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 01:00:06,156 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208301ea3fa91b349b6a96954bf8dd1b184_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20230208301ea3fa91b349b6a96954bf8dd1b184_del 2023-02-08 01:00:06,156 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-08 01:00:06,156 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230208effa3239f48f452cb1bc54cb225e9827_del] 2023-02-08 01:00:06,157 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 01:00:06,158 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230208effa3239f48f452cb1bc54cb225e9827_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20230208effa3239f48f452cb1bc54cb225e9827_del 2023-02-08 01:00:06,158 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-08 01:00:06,158 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] compactions.PartitionedMobCompactor(367): [hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208549e175c2611426597389902806d81cd_del] 2023-02-08 01:00:06,158 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] backup.HFileArchiver(360): Archiving compacted files. 2023-02-08 01:00:06,159 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208549e175c2611426597389902806d81cd_del to hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20230208549e175c2611426597389902806d81cd_del 2023-02-08 01:00:06,159 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-02-08 01:00:06,159 INFO [master/jenkins-hbase12:0:becomeActiveMaster-MasterMobCompaction-1675817736303] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-02-08 01:00:06,160 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-02-08 01:00:06,161 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.2540 sec 2023-02-08 01:00:06,181 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 01:00:06,183 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 01:00:06,186 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-02-08 01:00:06,186 DEBUG [Listener at localhost.localdomain/36213] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-02-08 01:00:06,190 INFO [Listener at localhost.localdomain/36213] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-02-08 01:00:06,219 INFO [Listener at localhost.localdomain/36213] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=246 (was 260), OpenFileDescriptor=609 (was 650), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=388 (was 315) - SystemLoadAverage LEAK? -, ProcessCount=177 (was 176) - ProcessCount LEAK? -, AvailableMemoryMB=3254 (was 3596) 2023-02-08 01:00:06,219 DEBUG [Listener at localhost.localdomain/36213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02632fa8 to 127.0.0.1:49726 2023-02-08 01:00:06,220 DEBUG [Listener at localhost.localdomain/36213] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 01:00:06,220 INFO [Listener at localhost.localdomain/36213] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-02-08 01:00:06,220 INFO [Listener at localhost.localdomain/36213] client.ConnectionImplementation(1959): Closing master protocol: MasterService 2023-02-08 01:00:06,220 DEBUG [Listener at localhost.localdomain/36213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x014a46d9 to 127.0.0.1:49726 2023-02-08 01:00:06,220 DEBUG [Listener at localhost.localdomain/36213] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 01:00:06,220 DEBUG [Listener at localhost.localdomain/36213] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-02-08 01:00:06,220 DEBUG [Listener at localhost.localdomain/36213] util.JVMClusterUtil(257): Found active master hash=574456497, stopped=false 2023-02-08 01:00:06,220 INFO [Listener at localhost.localdomain/36213] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase12.apache.org,36763,1675817725340 2023-02-08 01:00:06,387 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 01:00:06,387 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 01:00:06,387 INFO [Listener at localhost.localdomain/36213] procedure2.ProcedureExecutor(629): Stopping 2023-02-08 01:00:06,387 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-02-08 01:00:06,388 DEBUG [Listener at localhost.localdomain/36213] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x497dcd15 to 127.0.0.1:49726 2023-02-08 01:00:06,388 DEBUG [Listener at localhost.localdomain/36213] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 01:00:06,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 01:00:06,388 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-02-08 01:00:06,388 INFO [Listener at localhost.localdomain/36213] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase12.apache.org,36907,1675817727419' ***** 2023-02-08 01:00:06,388 INFO [Listener at localhost.localdomain/36213] regionserver.HRegionServer(2310): STOPPED: Shutdown requested 2023-02-08 01:00:06,388 INFO [RS:0;jenkins-hbase12:36907] regionserver.HeapMemoryManager(220): Stopping 2023-02-08 01:00:06,388 INFO [RS:0;jenkins-hbase12:36907] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-02-08 01:00:06,389 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-02-08 01:00:06,389 INFO [RS:0;jenkins-hbase12:36907] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-02-08 01:00:06,389 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 1b4691ee9ccf8ff7c27159984cbea63d 2023-02-08 01:00:06,389 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 27ddb7f5c95f0b9f97df2803a621f3c9 2023-02-08 01:00:06,389 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 3b0ead07198c1a0973ebc9c72e876b7b 2023-02-08 01:00:06,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 1b4691ee9ccf8ff7c27159984cbea63d, disabling compactions & flushes 2023-02-08 01:00:06,389 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 9338368da41aeb4a27fe667e7462918a 2023-02-08 01:00:06,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 8c482904a595e426d85ba975310b4bcc 2023-02-08 01:00:06,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 600f577ac8ccdcebef626e9d4a28aab8 2023-02-08 01:00:06,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. after waiting 0 ms 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for e60f76048dd578ad1c0ab31d5d11ddc7 2023-02-08 01:00:06,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for b50089805dc4677867e1dbc0df92d93d 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 7b259b18dbc55ddcae38c78ea5c268b7 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for cf587d948e645a697b6b2e156bc5c00c 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 2caf1b6dbcce2bc4cc85ec18a74d129f 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 84c1293d4c4595b4d6d33cad2b445d99 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 006ce3c661462075427cf7b5cb92f5d2 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 2ac42b7db01e98b42cdc33a9b82921f5 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for ede7c7bf0bdac5985188410295f2c926 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 89a0ab87c56c5be47f5c7e5dcda828ee 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for a9b1b2d3dd6bede138606a2ea05db424 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 308c8dc09348dd627b816fb996c571a1 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for cafd9b0cf7097e09cf9b7e7ea6e8da0a 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 3c9a9a588c7dcedde3924f81c89eb069 2023-02-08 01:00:06,390 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1145): stopping server jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 01:00:06,390 DEBUG [RS:0;jenkins-hbase12:36907] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e49bcf0 to 127.0.0.1:49726 2023-02-08 01:00:06,390 DEBUG [RS:0;jenkins-hbase12:36907] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 01:00:06,391 INFO [RS:0;jenkins-hbase12:36907] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-02-08 01:00:06,391 INFO [RS:0;jenkins-hbase12:36907] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-02-08 01:00:06,391 INFO [RS:0;jenkins-hbase12:36907] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-02-08 01:00:06,391 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(3304): Received CLOSE for 1588230740 2023-02-08 01:00:06,391 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1475): Waiting on 21 regions to close 2023-02-08 01:00:06,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 1588230740, disabling compactions & flushes 2023-02-08 01:00:06,391 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region hbase:meta,,1.1588230740 2023-02-08 01:00:06,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-02-08 01:00:06,391 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-02-08 01:00:06,392 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:meta,,1.1588230740 2023-02-08 01:00:06,392 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2744): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-02-08 01:00:06,392 DEBUG [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1505): Waiting on 006ce3c661462075427cf7b5cb92f5d2, 1588230740, 1b4691ee9ccf8ff7c27159984cbea63d, 27ddb7f5c95f0b9f97df2803a621f3c9, 2ac42b7db01e98b42cdc33a9b82921f5, 2caf1b6dbcce2bc4cc85ec18a74d129f, 308c8dc09348dd627b816fb996c571a1, 3b0ead07198c1a0973ebc9c72e876b7b, 3c9a9a588c7dcedde3924f81c89eb069, 600f577ac8ccdcebef626e9d4a28aab8, 7b259b18dbc55ddcae38c78ea5c268b7, 84c1293d4c4595b4d6d33cad2b445d99, 89a0ab87c56c5be47f5c7e5dcda828ee, 8c482904a595e426d85ba975310b4bcc, 9338368da41aeb4a27fe667e7462918a, a9b1b2d3dd6bede138606a2ea05db424, b50089805dc4677867e1dbc0df92d93d, cafd9b0cf7097e09cf9b7e7ea6e8da0a, cf587d948e645a697b6b2e156bc5c00c, e60f76048dd578ad1c0ab31d5d11ddc7, ede7c7bf0bdac5985188410295f2c926 2023-02-08 01:00:06,395 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/1b4691ee9ccf8ff7c27159984cbea63d/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-08 01:00:06,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 01:00:06,396 INFO [regionserver/jenkins-hbase12:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-02-08 01:00:06,396 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 1b4691ee9ccf8ff7c27159984cbea63d: Waiting for close lock at 1675818006389Running coprocessor pre-close hooks at 1675818006389Disabling compacts and flushes for region at 1675818006389Disabling writes for close at 1675818006390 (+1 ms)Writing region close event to WAL at 1675818006390Running coprocessor post-close hooks at 1675818006396 (+6 ms)Closed at 1675818006396 2023-02-08 01:00:06,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1675817866143.1b4691ee9ccf8ff7c27159984cbea63d. 2023-02-08 01:00:06,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 27ddb7f5c95f0b9f97df2803a621f3c9, disabling compactions & flushes 2023-02-08 01:00:06,397 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 01:00:06,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 01:00:06,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. after waiting 0 ms 2023-02-08 01:00:06,397 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 01:00:06,399 INFO [regionserver/jenkins-hbase12:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-02-08 01:00:06,406 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/27ddb7f5c95f0b9f97df2803a621f3c9/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-08 01:00:06,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 01:00:06,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 27ddb7f5c95f0b9f97df2803a621f3c9: Waiting for close lock at 1675818006397Running coprocessor pre-close hooks at 1675818006397Disabling compacts and flushes for region at 1675818006397Disabling writes for close at 1675818006397Writing region close event to WAL at 1675818006398 (+1 ms)Running coprocessor post-close hooks at 1675818006407 (+9 ms)Closed at 1675818006407 2023-02-08 01:00:06,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1675817933558.27ddb7f5c95f0b9f97df2803a621f3c9. 2023-02-08 01:00:06,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 3b0ead07198c1a0973ebc9c72e876b7b, disabling compactions & flushes 2023-02-08 01:00:06,407 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 01:00:06,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 01:00:06,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. after waiting 1 ms 2023-02-08 01:00:06,408 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 01:00:06,410 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/3b0ead07198c1a0973ebc9c72e876b7b/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 01:00:06,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 01:00:06,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 3b0ead07198c1a0973ebc9c72e876b7b: Waiting for close lock at 1675818006407Running coprocessor pre-close hooks at 1675818006407Disabling compacts and flushes for region at 1675818006407Disabling writes for close at 1675818006408 (+1 ms)Writing region close event to WAL at 1675818006408Running coprocessor post-close hooks at 1675818006410 (+2 ms)Closed at 1675818006411 (+1 ms) 2023-02-08 01:00:06,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1675817812942.3b0ead07198c1a0973ebc9c72e876b7b. 2023-02-08 01:00:06,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 9338368da41aeb4a27fe667e7462918a, disabling compactions & flushes 2023-02-08 01:00:06,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 01:00:06,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 01:00:06,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. after waiting 0 ms 2023-02-08 01:00:06,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 01:00:06,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/9338368da41aeb4a27fe667e7462918a/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-08 01:00:06,415 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 01:00:06,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 9338368da41aeb4a27fe667e7462918a: Waiting for close lock at 1675818006411Running coprocessor pre-close hooks at 1675818006411Disabling compacts and flushes for region at 1675818006411Disabling writes for close at 1675818006411Writing region close event to WAL at 1675818006413 (+2 ms)Running coprocessor post-close hooks at 1675818006415 (+2 ms)Closed at 1675818006415 2023-02-08 01:00:06,415 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1675817898885.9338368da41aeb4a27fe667e7462918a. 2023-02-08 01:00:06,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 8c482904a595e426d85ba975310b4bcc, disabling compactions & flushes 2023-02-08 01:00:06,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 01:00:06,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 01:00:06,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. after waiting 0 ms 2023-02-08 01:00:06,416 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 01:00:06,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/8c482904a595e426d85ba975310b4bcc/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-08 01:00:06,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 01:00:06,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 8c482904a595e426d85ba975310b4bcc: Waiting for close lock at 1675818006416Running coprocessor pre-close hooks at 1675818006416Disabling compacts and flushes for region at 1675818006416Disabling writes for close at 1675818006416Writing region close event to WAL at 1675818006416Running coprocessor post-close hooks at 1675818006419 (+3 ms)Closed at 1675818006419 2023-02-08 01:00:06,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1675817980119.8c482904a595e426d85ba975310b4bcc. 2023-02-08 01:00:06,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 600f577ac8ccdcebef626e9d4a28aab8, disabling compactions & flushes 2023-02-08 01:00:06,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 01:00:06,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 01:00:06,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. after waiting 0 ms 2023-02-08 01:00:06,420 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 01:00:06,425 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyPolicy/600f577ac8ccdcebef626e9d4a28aab8/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-08 01:00:06,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 01:00:06,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 600f577ac8ccdcebef626e9d4a28aab8: Waiting for close lock at 1675818006420Running coprocessor pre-close hooks at 1675818006420Disabling compacts and flushes for region at 1675818006420Disabling writes for close at 1675818006420Writing region close event to WAL at 1675818006420Running coprocessor post-close hooks at 1675818006426 (+6 ms)Closed at 1675818006426 2023-02-08 01:00:06,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1675817819071.600f577ac8ccdcebef626e9d4a28aab8. 2023-02-08 01:00:06,426 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing e60f76048dd578ad1c0ab31d5d11ddc7, disabling compactions & flushes 2023-02-08 01:00:06,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. 2023-02-08 01:00:06,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. 2023-02-08 01:00:06,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. after waiting 0 ms 2023-02-08 01:00:06,427 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. 2023-02-08 01:00:06,427 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2744): Flushing e60f76048dd578ad1c0ab31d5d11ddc7 1/1 column families, dataSize=109 B heapSize=592 B 2023-02-08 01:00:06,592 DEBUG [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1505): Waiting on 006ce3c661462075427cf7b5cb92f5d2, 1588230740, 2ac42b7db01e98b42cdc33a9b82921f5, 2caf1b6dbcce2bc4cc85ec18a74d129f, 308c8dc09348dd627b816fb996c571a1, 3c9a9a588c7dcedde3924f81c89eb069, 7b259b18dbc55ddcae38c78ea5c268b7, 84c1293d4c4595b4d6d33cad2b445d99, 89a0ab87c56c5be47f5c7e5dcda828ee, a9b1b2d3dd6bede138606a2ea05db424, b50089805dc4677867e1dbc0df92d93d, cafd9b0cf7097e09cf9b7e7ea6e8da0a, cf587d948e645a697b6b2e156bc5c00c, e60f76048dd578ad1c0ab31d5d11ddc7, ede7c7bf0bdac5985188410295f2c926 2023-02-08 01:00:06,793 DEBUG [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1505): Waiting on 006ce3c661462075427cf7b5cb92f5d2, 1588230740, 2ac42b7db01e98b42cdc33a9b82921f5, 2caf1b6dbcce2bc4cc85ec18a74d129f, 308c8dc09348dd627b816fb996c571a1, 3c9a9a588c7dcedde3924f81c89eb069, 7b259b18dbc55ddcae38c78ea5c268b7, 84c1293d4c4595b4d6d33cad2b445d99, 89a0ab87c56c5be47f5c7e5dcda828ee, a9b1b2d3dd6bede138606a2ea05db424, b50089805dc4677867e1dbc0df92d93d, cafd9b0cf7097e09cf9b7e7ea6e8da0a, cf587d948e645a697b6b2e156bc5c00c, e60f76048dd578ad1c0ab31d5d11ddc7, ede7c7bf0bdac5985188410295f2c926 2023-02-08 01:00:06,810 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/.tmp/info/f79139e06e594bbc84ed46493be2b5ad 2023-02-08 01:00:06,818 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f79139e06e594bbc84ed46493be2b5ad 2023-02-08 01:00:06,838 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/namespace/e60f76048dd578ad1c0ab31d5d11ddc7/.tmp/info/36cc71f0a4124b30bb2e4ed0d7de9e68 2023-02-08 01:00:06,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/namespace/e60f76048dd578ad1c0ab31d5d11ddc7/.tmp/info/36cc71f0a4124b30bb2e4ed0d7de9e68 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/namespace/e60f76048dd578ad1c0ab31d5d11ddc7/info/36cc71f0a4124b30bb2e4ed0d7de9e68 2023-02-08 01:00:06,848 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/namespace/e60f76048dd578ad1c0ab31d5d11ddc7/info/36cc71f0a4124b30bb2e4ed0d7de9e68, entries=3, sequenceid=7, filesize=4.8 K 2023-02-08 01:00:06,849 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for e60f76048dd578ad1c0ab31d5d11ddc7 in 422ms, sequenceid=7, compaction requested=false 2023-02-08 01:00:06,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/namespace/e60f76048dd578ad1c0ab31d5d11ddc7/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-02-08 01:00:06,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. 2023-02-08 01:00:06,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for e60f76048dd578ad1c0ab31d5d11ddc7: Waiting for close lock at 1675818006426Running coprocessor pre-close hooks at 1675818006426Disabling compacts and flushes for region at 1675818006426Disabling writes for close at 1675818006427 (+1 ms)Obtaining lock to block concurrent updates at 1675818006427Preparing flush snapshotting stores in e60f76048dd578ad1c0ab31d5d11ddc7 at 1675818006427Finished memstore snapshotting hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7., syncing WAL and waiting on mvcc, flushsize=dataSize=109, getHeapSize=576, getOffHeapSize=0, getCellsCount=3 at 1675818006427Flushing stores of hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. at 1675818006427Flushing e60f76048dd578ad1c0ab31d5d11ddc7/info: creating writer at 1675818006427Flushing e60f76048dd578ad1c0ab31d5d11ddc7/info: appending metadata at 1675818006429 (+2 ms)Flushing e60f76048dd578ad1c0ab31d5d11ddc7/info: closing flushed file at 1675818006429Flushing e60f76048dd578ad1c0ab31d5d11ddc7/info: reopening flushed file at 1675818006843 (+414 ms)Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for e60f76048dd578ad1c0ab31d5d11ddc7 in 422ms, sequenceid=7, compaction requested=false at 1675818006849 (+6 ms)Writing region close event to WAL at 1675818006850 (+1 ms)Running coprocessor post-close hooks at 1675818006853 (+3 ms)Closed at 1675818006854 (+1 ms) 2023-02-08 01:00:06,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1675817732791.e60f76048dd578ad1c0ab31d5d11ddc7. 2023-02-08 01:00:06,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing b50089805dc4677867e1dbc0df92d93d, disabling compactions & flushes 2023-02-08 01:00:06,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 01:00:06,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 01:00:06,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. after waiting 0 ms 2023-02-08 01:00:06,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 01:00:06,857 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/b50089805dc4677867e1dbc0df92d93d/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-02-08 01:00:06,857 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 01:00:06,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for b50089805dc4677867e1dbc0df92d93d: Waiting for close lock at 1675818006854Running coprocessor pre-close hooks at 1675818006854Disabling compacts and flushes for region at 1675818006854Disabling writes for close at 1675818006854Writing region close event to WAL at 1675818006855 (+1 ms)Running coprocessor post-close hooks at 1675818006857 (+2 ms)Closed at 1675818006857 2023-02-08 01:00:06,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1675817812942.b50089805dc4677867e1dbc0df92d93d. 2023-02-08 01:00:06,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 7b259b18dbc55ddcae38c78ea5c268b7, disabling compactions & flushes 2023-02-08 01:00:06,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 01:00:06,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 01:00:06,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. after waiting 0 ms 2023-02-08 01:00:06,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 01:00:06,860 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/7b259b18dbc55ddcae38c78ea5c268b7/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-02-08 01:00:06,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 01:00:06,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 7b259b18dbc55ddcae38c78ea5c268b7: Waiting for close lock at 1675818006858Running coprocessor pre-close hooks at 1675818006858Disabling compacts and flushes for region at 1675818006858Disabling writes for close at 1675818006858Writing region close event to WAL at 1675818006858Running coprocessor post-close hooks at 1675818006861 (+3 ms)Closed at 1675818006861 2023-02-08 01:00:06,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1675817840792.7b259b18dbc55ddcae38c78ea5c268b7. 2023-02-08 01:00:06,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing cf587d948e645a697b6b2e156bc5c00c, disabling compactions & flushes 2023-02-08 01:00:06,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 01:00:06,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 01:00:06,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. after waiting 0 ms 2023-02-08 01:00:06,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 01:00:06,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithMonthlyPolicy/cf587d948e645a697b6b2e156bc5c00c/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-08 01:00:06,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 01:00:06,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for cf587d948e645a697b6b2e156bc5c00c: Waiting for close lock at 1675818006861Running coprocessor pre-close hooks at 1675818006861Disabling compacts and flushes for region at 1675818006861Disabling writes for close at 1675818006862 (+1 ms)Writing region close event to WAL at 1675818006862Running coprocessor post-close hooks at 1675818006865 (+3 ms)Closed at 1675818006866 (+1 ms) 2023-02-08 01:00:06,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1675817956898.cf587d948e645a697b6b2e156bc5c00c. 2023-02-08 01:00:06,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 2caf1b6dbcce2bc4cc85ec18a74d129f, disabling compactions & flushes 2023-02-08 01:00:06,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 01:00:06,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 01:00:06,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. after waiting 0 ms 2023-02-08 01:00:06,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 01:00:06,869 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithMonthlyPolicy/2caf1b6dbcce2bc4cc85ec18a74d129f/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-02-08 01:00:06,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 01:00:06,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 2caf1b6dbcce2bc4cc85ec18a74d129f: Waiting for close lock at 1675818006866Running coprocessor pre-close hooks at 1675818006866Disabling compacts and flushes for region at 1675818006866Disabling writes for close at 1675818006866Writing region close event to WAL at 1675818006867 (+1 ms)Running coprocessor post-close hooks at 1675818006870 (+3 ms)Closed at 1675818006870 2023-02-08 01:00:06,870 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1675817761149.2caf1b6dbcce2bc4cc85ec18a74d129f. 2023-02-08 01:00:06,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 84c1293d4c4595b4d6d33cad2b445d99, disabling compactions & flushes 2023-02-08 01:00:06,871 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 01:00:06,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 01:00:06,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. after waiting 0 ms 2023-02-08 01:00:06,871 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 01:00:06,875 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/84c1293d4c4595b4d6d33cad2b445d99/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-08 01:00:06,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 01:00:06,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 84c1293d4c4595b4d6d33cad2b445d99: Waiting for close lock at 1675818006871Running coprocessor pre-close hooks at 1675818006871Disabling compacts and flushes for region at 1675818006871Disabling writes for close at 1675818006871Writing region close event to WAL at 1675818006872 (+1 ms)Running coprocessor post-close hooks at 1675818006875 (+3 ms)Closed at 1675818006876 (+1 ms) 2023-02-08 01:00:06,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1675817898885.84c1293d4c4595b4d6d33cad2b445d99. 2023-02-08 01:00:06,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 006ce3c661462075427cf7b5cb92f5d2, disabling compactions & flushes 2023-02-08 01:00:06,876 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 01:00:06,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 01:00:06,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. after waiting 0 ms 2023-02-08 01:00:06,876 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 01:00:06,880 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/006ce3c661462075427cf7b5cb92f5d2/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-02-08 01:00:06,881 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 01:00:06,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 006ce3c661462075427cf7b5cb92f5d2: Waiting for close lock at 1675818006876Running coprocessor pre-close hooks at 1675818006876Disabling compacts and flushes for region at 1675818006876Disabling writes for close at 1675818006876Writing region close event to WAL at 1675818006877 (+1 ms)Running coprocessor post-close hooks at 1675818006880 (+3 ms)Closed at 1675818006881 (+1 ms) 2023-02-08 01:00:06,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1675817736805.006ce3c661462075427cf7b5cb92f5d2. 2023-02-08 01:00:06,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 2ac42b7db01e98b42cdc33a9b82921f5, disabling compactions & flushes 2023-02-08 01:00:06,882 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 01:00:06,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 01:00:06,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. after waiting 0 ms 2023-02-08 01:00:06,882 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 01:00:06,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/2ac42b7db01e98b42cdc33a9b82921f5/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-08 01:00:06,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 01:00:06,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 2ac42b7db01e98b42cdc33a9b82921f5: Waiting for close lock at 1675818006882Running coprocessor pre-close hooks at 1675818006882Disabling compacts and flushes for region at 1675818006882Disabling writes for close at 1675818006882Writing region close event to WAL at 1675818006883 (+1 ms)Running coprocessor post-close hooks at 1675818006886 (+3 ms)Closed at 1675818006886 2023-02-08 01:00:06,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1675817933558.2ac42b7db01e98b42cdc33a9b82921f5. 2023-02-08 01:00:06,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing ede7c7bf0bdac5985188410295f2c926, disabling compactions & flushes 2023-02-08 01:00:06,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 01:00:06,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 01:00:06,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. after waiting 0 ms 2023-02-08 01:00:06,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 01:00:06,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/ede7c7bf0bdac5985188410295f2c926/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-08 01:00:06,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 01:00:06,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for ede7c7bf0bdac5985188410295f2c926: Waiting for close lock at 1675818006886Running coprocessor pre-close hooks at 1675818006886Disabling compacts and flushes for region at 1675818006886Disabling writes for close at 1675818006887 (+1 ms)Writing region close event to WAL at 1675818006888 (+1 ms)Running coprocessor post-close hooks at 1675818006892 (+4 ms)Closed at 1675818006892 2023-02-08 01:00:06,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1675817980119.ede7c7bf0bdac5985188410295f2c926. 2023-02-08 01:00:06,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 89a0ab87c56c5be47f5c7e5dcda828ee, disabling compactions & flushes 2023-02-08 01:00:06,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 01:00:06,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 01:00:06,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. after waiting 0 ms 2023-02-08 01:00:06,892 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 01:00:06,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testCompactionWithHFileLink/89a0ab87c56c5be47f5c7e5dcda828ee/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-02-08 01:00:06,897 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 01:00:06,897 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 89a0ab87c56c5be47f5c7e5dcda828ee: Waiting for close lock at 1675818006892Running coprocessor pre-close hooks at 1675818006892Disabling compacts and flushes for region at 1675818006892Disabling writes for close at 1675818006892Writing region close event to WAL at 1675818006894 (+2 ms)Running coprocessor post-close hooks at 1675818006897 (+3 ms)Closed at 1675818006897 2023-02-08 01:00:06,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1675817898885.89a0ab87c56c5be47f5c7e5dcda828ee. 2023-02-08 01:00:06,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing a9b1b2d3dd6bede138606a2ea05db424, disabling compactions & flushes 2023-02-08 01:00:06,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 01:00:06,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 01:00:06,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. after waiting 0 ms 2023-02-08 01:00:06,898 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 01:00:06,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/ns/testMinorCompaction/a9b1b2d3dd6bede138606a2ea05db424/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-08 01:00:06,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 01:00:06,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for a9b1b2d3dd6bede138606a2ea05db424: Waiting for close lock at 1675818006898Running coprocessor pre-close hooks at 1675818006898Disabling compacts and flushes for region at 1675818006898Disabling writes for close at 1675818006898Writing region close event to WAL at 1675818006899 (+1 ms)Running coprocessor post-close hooks at 1675818006903 (+4 ms)Closed at 1675818006903 2023-02-08 01:00:06,903 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1675817933558.a9b1b2d3dd6bede138606a2ea05db424. 2023-02-08 01:00:06,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 308c8dc09348dd627b816fb996c571a1, disabling compactions & flushes 2023-02-08 01:00:06,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 01:00:06,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 01:00:06,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. after waiting 0 ms 2023-02-08 01:00:06,904 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 01:00:06,907 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMinorCompactionWithWeeklyPolicy/308c8dc09348dd627b816fb996c571a1/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-02-08 01:00:06,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 01:00:06,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 308c8dc09348dd627b816fb996c571a1: Waiting for close lock at 1675818006904Running coprocessor pre-close hooks at 1675818006904Disabling compacts and flushes for region at 1675818006904Disabling writes for close at 1675818006904Writing region close event to WAL at 1675818006905 (+1 ms)Running coprocessor post-close hooks at 1675818006908 (+3 ms)Closed at 1675818006908 2023-02-08 01:00:06,908 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1675817786076.308c8dc09348dd627b816fb996c571a1. 2023-02-08 01:00:06,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing cafd9b0cf7097e09cf9b7e7ea6e8da0a, disabling compactions & flushes 2023-02-08 01:00:06,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 01:00:06,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 01:00:06,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. after waiting 0 ms 2023-02-08 01:00:06,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 01:00:06,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testScannerOnBulkLoadRefHFiles/cafd9b0cf7097e09cf9b7e7ea6e8da0a/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-02-08 01:00:06,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 01:00:06,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for cafd9b0cf7097e09cf9b7e7ea6e8da0a: Waiting for close lock at 1675818006908Running coprocessor pre-close hooks at 1675818006908Disabling compacts and flushes for region at 1675818006908Disabling writes for close at 1675818006909 (+1 ms)Writing region close event to WAL at 1675818006909Running coprocessor post-close hooks at 1675818006912 (+3 ms)Closed at 1675818006912 2023-02-08 01:00:06,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1675817812942.cafd9b0cf7097e09cf9b7e7ea6e8da0a. 2023-02-08 01:00:06,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1603): Closing 3c9a9a588c7dcedde3924f81c89eb069, disabling compactions & flushes 2023-02-08 01:00:06,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1625): Closing region testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 01:00:06,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1646): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 01:00:06,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1713): Acquired close lock on testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. after waiting 0 ms 2023-02-08 01:00:06,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1723): Updates disabled for region testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 01:00:06,916 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/default/testMajorCompactionFromAdmin/3c9a9a588c7dcedde3924f81c89eb069/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-02-08 01:00:06,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 01:00:06,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 3c9a9a588c7dcedde3924f81c89eb069: Waiting for close lock at 1675818006913Running coprocessor pre-close hooks at 1675818006913Disabling compacts and flushes for region at 1675818006913Disabling writes for close at 1675818006913Writing region close event to WAL at 1675818006914 (+1 ms)Running coprocessor post-close hooks at 1675818006917 (+3 ms)Closed at 1675818006917 2023-02-08 01:00:06,917 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1675817980119.3c9a9a588c7dcedde3924f81c89eb069. 2023-02-08 01:00:06,920 INFO [regionserver/jenkins-hbase12:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-02-08 01:00:06,920 INFO [regionserver/jenkins-hbase12:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-02-08 01:00:06,993 DEBUG [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 01:00:07,194 DEBUG [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1505): Waiting on 1588230740 2023-02-08 01:00:07,227 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/.tmp/rep_barrier/28d685e8d53248a6bea937a5b5772816 2023-02-08 01:00:07,237 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28d685e8d53248a6bea937a5b5772816 2023-02-08 01:00:07,246 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/.tmp/table/4166fa19b9dc4070a66c3b700cb11a4c 2023-02-08 01:00:07,251 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4166fa19b9dc4070a66c3b700cb11a4c 2023-02-08 01:00:07,252 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/.tmp/info/f79139e06e594bbc84ed46493be2b5ad as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/info/f79139e06e594bbc84ed46493be2b5ad 2023-02-08 01:00:07,256 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f79139e06e594bbc84ed46493be2b5ad 2023-02-08 01:00:07,256 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/info/f79139e06e594bbc84ed46493be2b5ad, entries=226, sequenceid=130, filesize=37.9 K 2023-02-08 01:00:07,257 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/.tmp/rep_barrier/28d685e8d53248a6bea937a5b5772816 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/rep_barrier/28d685e8d53248a6bea937a5b5772816 2023-02-08 01:00:07,261 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 28d685e8d53248a6bea937a5b5772816 2023-02-08 01:00:07,261 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/rep_barrier/28d685e8d53248a6bea937a5b5772816, entries=1, sequenceid=130, filesize=5.0 K 2023-02-08 01:00:07,262 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/.tmp/table/4166fa19b9dc4070a66c3b700cb11a4c as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/table/4166fa19b9dc4070a66c3b700cb11a4c 2023-02-08 01:00:07,266 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4166fa19b9dc4070a66c3b700cb11a4c 2023-02-08 01:00:07,266 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/table/4166fa19b9dc4070a66c3b700cb11a4c, entries=27, sequenceid=130, filesize=6.6 K 2023-02-08 01:00:07,269 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(2947): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 877ms, sequenceid=130, compaction requested=false 2023-02-08 01:00:07,272 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-02-08 01:00:07,273 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-02-08 01:00:07,273 INFO [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1837): Closed hbase:meta,,1.1588230740 2023-02-08 01:00:07,273 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] regionserver.HRegion(1557): Region close journal for 1588230740: Waiting for close lock at 1675818006391Running coprocessor pre-close hooks at 1675818006391Disabling compacts and flushes for region at 1675818006391Disabling writes for close at 1675818006391Obtaining lock to block concurrent updates at 1675818006392 (+1 ms)Preparing flush snapshotting stores in 1588230740 at 1675818006392Finished memstore snapshotting hbase:meta,,1.1588230740, syncing WAL and waiting on mvcc, flushsize=dataSize=51839, getHeapSize=80064, getOffHeapSize=0, getCellsCount=365 at 1675818006392Flushing stores of hbase:meta,,1.1588230740 at 1675818006392Flushing 1588230740/info: creating writer at 1675818006392Flushing 1588230740/info: appending metadata at 1675818006399 (+7 ms)Flushing 1588230740/info: closing flushed file at 1675818006399Flushing 1588230740/rep_barrier: creating writer at 1675818006819 (+420 ms)Flushing 1588230740/rep_barrier: appending metadata at 1675818006821 (+2 ms)Flushing 1588230740/rep_barrier: closing flushed file at 1675818006821Flushing 1588230740/table: creating writer at 1675818007237 (+416 ms)Flushing 1588230740/table: appending metadata at 1675818007242 (+5 ms)Flushing 1588230740/table: closing flushed file at 1675818007242Flushing 1588230740/info: reopening flushed file at 1675818007252 (+10 ms)Flushing 1588230740/rep_barrier: reopening flushed file at 1675818007257 (+5 ms)Flushing 1588230740/table: reopening flushed file at 1675818007263 (+6 ms)Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 877ms, sequenceid=130, compaction requested=false at 1675818007269 (+6 ms)Writing region close event to WAL at 1675818007270 (+1 ms)Running coprocessor post-close hooks at 1675818007273 (+3 ms)Closed at 1675818007273 2023-02-08 01:00:07,273 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase12:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-02-08 01:00:07,394 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1171): stopping server jenkins-hbase12.apache.org,36907,1675817727419; all regions closed. 2023-02-08 01:00:07,403 DEBUG [RS:0;jenkins-hbase12:36907] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/oldWALs 2023-02-08 01:00:07,403 INFO [RS:0;jenkins-hbase12:36907] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase12.apache.org%2C36907%2C1675817727419.meta:.meta(num 1675817732084) 2023-02-08 01:00:07,408 DEBUG [RS:0;jenkins-hbase12:36907] wal.AbstractFSWAL(932): Moved 1 WAL file(s) to /user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/oldWALs 2023-02-08 01:00:07,408 INFO [RS:0;jenkins-hbase12:36907] wal.AbstractFSWAL(935): Closed WAL: AsyncFSWAL jenkins-hbase12.apache.org%2C36907%2C1675817727419:(num 1675817732070) 2023-02-08 01:00:07,408 DEBUG [RS:0;jenkins-hbase12:36907] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 01:00:07,408 INFO [RS:0;jenkins-hbase12:36907] regionserver.LeaseManager(133): Closed leases 2023-02-08 01:00:07,409 INFO [RS:0;jenkins-hbase12:36907] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase12:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-02-08 01:00:07,409 INFO [regionserver/jenkins-hbase12:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 01:00:07,410 INFO [RS:0;jenkins-hbase12:36907] ipc.NettyRpcServer(158): Stopping server on /136.243.104.168:36907 2023-02-08 01:00:07,812 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 01:00:07,812 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase12.apache.org,36907,1675817727419 2023-02-08 01:00:07,813 ERROR [Listener at localhost.localdomain/36213-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@210b64d6 rejected from java.util.concurrent.ThreadPoolExecutor@2534e42f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 01:00:07,814 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-02-08 01:00:07,813 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase12.apache.org,36907,1675817727419] 2023-02-08 01:00:07,814 ERROR [Listener at localhost.localdomain/36213-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@2b4ba3c3 rejected from java.util.concurrent.ThreadPoolExecutor@2534e42f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 01:00:07,815 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase12.apache.org,36907,1675817727419; numProcessing=1 2023-02-08 01:00:07,848 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase12.apache.org,36907,1675817727419 already deleted, retry=false 2023-02-08 01:00:07,848 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase12.apache.org,36907,1675817727419 expired; onlineServers=0 2023-02-08 01:00:07,848 INFO [RegionServerTracker-0] regionserver.HRegionServer(2296): ***** STOPPING region server 'jenkins-hbase12.apache.org,36763,1675817725340' ***** 2023-02-08 01:00:07,848 INFO [RegionServerTracker-0] regionserver.HRegionServer(2310): STOPPED: Cluster shutdown set; onlineServer=0 2023-02-08 01:00:07,849 DEBUG [M:0;jenkins-hbase12:36763] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6300888a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase12.apache.org/136.243.104.168:0 2023-02-08 01:00:07,849 INFO [M:0;jenkins-hbase12:36763] regionserver.HRegionServer(1145): stopping server jenkins-hbase12.apache.org,36763,1675817725340 2023-02-08 01:00:07,849 INFO [M:0;jenkins-hbase12:36763] regionserver.HRegionServer(1171): stopping server jenkins-hbase12.apache.org,36763,1675817725340; all regions closed. 2023-02-08 01:00:07,849 DEBUG [M:0;jenkins-hbase12:36763] ipc.AbstractRpcClient(495): Stopping rpc client 2023-02-08 01:00:07,849 DEBUG [M:0;jenkins-hbase12:36763] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-02-08 01:00:07,849 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-02-08 01:00:07,849 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.small.0-1675817730919] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.small.0-1675817730919,5,FailOnTimeoutGroup] 2023-02-08 01:00:07,849 DEBUG [master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.large.0-1675817730919] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase12:0:becomeActiveMaster-HFileCleaner.large.0-1675817730919,5,FailOnTimeoutGroup] 2023-02-08 01:00:07,849 DEBUG [M:0;jenkins-hbase12:36763] cleaner.HFileCleaner(317): Stopping file delete threads 2023-02-08 01:00:07,849 INFO [M:0;jenkins-hbase12:36763] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-02-08 01:00:07,849 INFO [M:0;jenkins-hbase12:36763] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-02-08 01:00:07,849 INFO [M:0;jenkins-hbase12:36763] hbase.ChoreService(369): Chore service for: master/jenkins-hbase12:0 had [] on shutdown 2023-02-08 01:00:07,850 DEBUG [M:0;jenkins-hbase12:36763] master.HMaster(1502): Stopping service threads 2023-02-08 01:00:07,850 INFO [M:0;jenkins-hbase12:36763] procedure2.RemoteProcedureDispatcher(118): Stopping procedure remote dispatcher 2023-02-08 01:00:07,850 ERROR [M:0;jenkins-hbase12:36763] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-02-08 01:00:07,851 INFO [M:0;jenkins-hbase12:36763] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-02-08 01:00:07,851 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-02-08 01:00:07,923 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 01:00:07,923 INFO [RS:0;jenkins-hbase12:36907] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase12.apache.org,36907,1675817727419; zookeeper connection closed. 2023-02-08 01:00:07,923 ERROR [Listener at localhost.localdomain/36213-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@538bdc38 rejected from java.util.concurrent.ThreadPoolExecutor@2534e42f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 01:00:07,923 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): regionserver:36907-0x1014010f5da0001, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 01:00:07,923 ERROR [Listener at localhost.localdomain/36213-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@76ba6fd9 rejected from java.util.concurrent.ThreadPoolExecutor@2534e42f[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 532] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 01:00:07,923 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@29962ba2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@29962ba2 2023-02-08 01:00:07,923 INFO [Listener at localhost.localdomain/36213] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-02-08 01:00:08,013 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-02-08 01:00:08,013 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-02-08 01:00:08,013 DEBUG [M:0;jenkins-hbase12:36763] zookeeper.ZKUtil(398): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-02-08 01:00:08,013 WARN [M:0;jenkins-hbase12:36763] master.ActiveMasterManager(323): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-02-08 01:00:08,013 INFO [M:0;jenkins-hbase12:36763] assignment.AssignmentManager(315): Stopping assignment manager 2023-02-08 01:00:08,013 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-02-08 01:00:08,014 INFO [M:0;jenkins-hbase12:36763] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-02-08 01:00:08,014 DEBUG [M:0;jenkins-hbase12:36763] regionserver.HRegion(1603): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-02-08 01:00:08,014 INFO [M:0;jenkins-hbase12:36763] regionserver.HRegion(1625): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 01:00:08,014 DEBUG [M:0;jenkins-hbase12:36763] regionserver.HRegion(1646): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 01:00:08,014 DEBUG [M:0;jenkins-hbase12:36763] regionserver.HRegion(1713): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-02-08 01:00:08,014 DEBUG [M:0;jenkins-hbase12:36763] regionserver.HRegion(1723): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 01:00:08,014 INFO [M:0;jenkins-hbase12:36763] regionserver.HRegion(2744): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.50 KB heapSize=599.77 KB 2023-02-08 01:00:08,428 INFO [M:0;jenkins-hbase12:36763] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.50 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7c12b96832964fb0bc405520972bd7b2 2023-02-08 01:00:08,432 INFO [M:0;jenkins-hbase12:36763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c12b96832964fb0bc405520972bd7b2 2023-02-08 01:00:08,433 DEBUG [M:0;jenkins-hbase12:36763] regionserver.HRegionFileSystem(485): Committing hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7c12b96832964fb0bc405520972bd7b2 as hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7c12b96832964fb0bc405520972bd7b2 2023-02-08 01:00:08,438 INFO [M:0;jenkins-hbase12:36763] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7c12b96832964fb0bc405520972bd7b2 2023-02-08 01:00:08,438 INFO [M:0;jenkins-hbase12:36763] regionserver.HStore(1080): Added hdfs://localhost.localdomain:37369/user/jenkins/test-data/663f4add-234d-991c-d0ae-a02669ff3435/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7c12b96832964fb0bc405520972bd7b2, entries=123, sequenceid=1011, filesize=33.3 K 2023-02-08 01:00:08,439 INFO [M:0;jenkins-hbase12:36763] regionserver.HRegion(2947): Finished flush of dataSize ~513.50 KB/525827, heapSize ~599.75 KB/614144, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 425ms, sequenceid=1011, compaction requested=false 2023-02-08 01:00:08,440 INFO [M:0;jenkins-hbase12:36763] regionserver.HRegion(1837): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-02-08 01:00:08,440 DEBUG [M:0;jenkins-hbase12:36763] regionserver.HRegion(1557): Region close journal for 1595e783b53d99cd5eef43b6debb2682: Waiting for close lock at 1675818008014Disabling compacts and flushes for region at 1675818008014Disabling writes for close at 1675818008014Obtaining lock to block concurrent updates at 1675818008014Preparing flush snapshotting stores in 1595e783b53d99cd5eef43b6debb2682 at 1675818008014Finished memstore snapshotting master:store,,1.1595e783b53d99cd5eef43b6debb2682., syncing WAL and waiting on mvcc, flushsize=dataSize=525827, getHeapSize=614144, getOffHeapSize=0, getCellsCount=1166 at 1675818008014Flushing stores of master:store,,1.1595e783b53d99cd5eef43b6debb2682. at 1675818008015 (+1 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: creating writer at 1675818008015Flushing 1595e783b53d99cd5eef43b6debb2682/proc: appending metadata at 1675818008021 (+6 ms)Flushing 1595e783b53d99cd5eef43b6debb2682/proc: closing flushed file at 1675818008021Flushing 1595e783b53d99cd5eef43b6debb2682/proc: reopening flushed file at 1675818008433 (+412 ms)Finished flush of dataSize ~513.50 KB/525827, heapSize ~599.75 KB/614144, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 425ms, sequenceid=1011, compaction requested=false at 1675818008439 (+6 ms)Writing region close event to WAL at 1675818008440 (+1 ms)Closed at 1675818008440 2023-02-08 01:00:08,444 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-02-08 01:00:08,444 INFO [M:0;jenkins-hbase12:36763] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-02-08 01:00:08,445 INFO [M:0;jenkins-hbase12:36763] ipc.NettyRpcServer(158): Stopping server on /136.243.104.168:36763 2023-02-08 01:00:08,781 DEBUG [M:0;jenkins-hbase12:36763] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase12.apache.org,36763,1675817725340 already deleted, retry=false 2023-02-08 01:00:08,926 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 01:00:08,926 INFO [M:0;jenkins-hbase12:36763] regionserver.HRegionServer(1228): Exiting; stopping=jenkins-hbase12.apache.org,36763,1675817725340; zookeeper connection closed. 2023-02-08 01:00:08,927 ERROR [Listener at localhost.localdomain/36213-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@6f38e4cf rejected from java.util.concurrent.ThreadPoolExecutor@7decb8d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 01:00:08,927 DEBUG [Listener at localhost.localdomain/36213-EventThread] zookeeper.ZKWatcher(600): master:36763-0x1014010f5da0000, quorum=127.0.0.1:49726, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-02-08 01:00:08,927 ERROR [Listener at localhost.localdomain/36213-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@451fe6e4 rejected from java.util.concurrent.ThreadPoolExecutor@7decb8d[Terminated, pool size = 0, active threads = 0, queued tasks = 0, completed tasks = 907] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1379) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:602) at org.apache.hadoop.hbase.zookeeper.PendingWatcher.process(PendingWatcher.java:38) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-02-08 01:00:08,929 WARN [Listener at localhost.localdomain/36213] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-02-08 01:00:08,933 INFO [Listener at localhost.localdomain/36213] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-02-08 01:00:09,041 WARN [BP-181553309-136.243.104.168-1675817718719 heartbeating to localhost.localdomain/127.0.0.1:37369] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-02-08 01:00:09,041 WARN [BP-181553309-136.243.104.168-1675817718719 heartbeating to localhost.localdomain/127.0.0.1:37369] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-181553309-136.243.104.168-1675817718719 (Datanode Uuid 0f7453a4-3ea6-4c3e-bbee-63344e1aef86) service to localhost.localdomain/127.0.0.1:37369 2023-02-08 01:00:09,043 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/cluster_30866e7d-579c-f29f-9e7a-6f29114e302b/dfs/data/data1/current/BP-181553309-136.243.104.168-1675817718719] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 01:00:09,043 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b8be008c-73c6-c7da-1205-82ba04c7f42d/cluster_30866e7d-579c-f29f-9e7a-6f29114e302b/dfs/data/data2/current/BP-181553309-136.243.104.168-1675817718719] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-02-08 01:00:09,071 INFO [Listener at localhost.localdomain/36213] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost.localdomain:0 2023-02-08 01:00:09,202 INFO [Listener at localhost.localdomain/36213] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-02-08 01:00:09,282 INFO [Listener at localhost.localdomain/36213] hbase.HBaseTestingUtility(1293): Minicluster is down